That's Fresh! Newsletter
Read a selection of our past issues.
- Google's answer to ChatGPTAnd: Generating synthetic data within relational databases. Let's meet at WAICF!February 8, 2023
- Understanding ChatGPT betterAnd: How to deal with imbalanced data. More about our productDecember 14, 2022
- A curated list of failed ML projectsAnd: How to build a data strategy. Clearbox AI and Bearing Point partnership.November 16, 2022
- Our open source library is now on GitHubAnd: Clearbox AI on Cybernews.June 22, 2022
- Discovering DagsterAnd: Quantifying privacy risks. Use case: a synthetic data sandbox to freely share data.June 8, 2022
- Can interaction data be fully anonymized?And: Synthetic Data for privacy preservation: understanding privacy risks. Discover our Enterprise solution.April 6, 2022
- What are GFlow nets?And: Improve models with Synthetic Data. Use case: augment financial time series.March 16, 2022
- The European Commission selected us for Women TechEU pilot project!And: What is Synthetic Data. The new Synthetic Data platform.March 09, 2022
- The EDPS on Synthetic DataAnd: From raw to good quality data. Changelogs: now you can upload unlabeled datasets.February 23, 2022
- 2022 Gartner’s Technology TrendsAnd: How to harness the power of AI in companies. Changelogs: new metrics available for your synthetic dataset.February 09, 2022
Synthetic Data is becoming increasingly mainstream. Gartner predicts that 60% of AI models will use Synthetic Data in some form or another by 2025, and in its recent market trends report also reiterated the importance of generative AI that fuels synthetic data generation in its recent hype cycle.
While there are many advantages of Synthetic Data that are driving this trend, not to mention data augmentation, cost-effective and safe data procurement, the main focus these days seems to be on its role in privacy preservation and enhancement. Last week the office of the European Data Protection Supervisor weighed in on the topic in the opinion piece you can find in the box below.
The advantages of Synthetic Data as stated in the article are mainly directed at using it for privacy preserving AI model development as well as a privacy enhancing method for sharing personal data. The article also issues a note of caution on the challenges of risk of re-identification of personal data, anonymisation and other unforeseen risks.
The article reflects a general opinion of advantages and challenges of synthetic datasets, but it misses to discuss how the challenges can be mitigated using a risk based approach and also downplays its advantages.
Quantifying the risks can help the users of Synthetic Data make smart choices while dealing with utility vs privacy conundrum. One such approach is differential privacy. According to NIST: “A differentially private synthetic dataset looks like the original dataset - it has the same schema and attempts to maintain properties of the original dataset (e.g., correlations between attributes) - but it provides a provable privacy guarantee for individuals in the original dataset.”
Since Synthetic Data will continue to play a major role in AI and analytics we think that a risk quantification approach to privacy will help companies to capitalise on good quality synthetic data to accelerate responsible innovation.
What is Synthetic Data? Which are its benefits and risks? The European Data Protection Supervisor recently published a piece that addresses the topics.
Among tabular datasets, now you can analyse and generate Synthetic Data for unlabeled datasets, i.e. datasets that do not (yet) have a target column.
Find out the most frequent problems with raw data and the techniques to mitigate them in the second chapter of our Data Preparation guide.