Neosync
@neosynccloud
Followers
334
Following
8
Media
23
Statuses
104
Open source test data platform built for developers. Easily create anonymized, secure test data and sync it across all of your environments. @Ycombinator
San Francisco, California
Joined May 2022
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Madison Square Garden
• 935540 Tweets
Puerto Rico
• 209119 Tweets
#MexicoGP
• 205960 Tweets
Tony
• 145476 Tweets
Perez
• 137366 Tweets
Boulos
• 132138 Tweets
Sainz
• 131606 Tweets
Jets
• 130105 Tweets
Charles
• 119821 Tweets
Ferrari
• 108273 Tweets
Verstappen
• 99334 Tweets
Norris
• 95074 Tweets
Fortaleza
• 91766 Tweets
Nunes
• 90076 Tweets
Browns
• 88766 Tweets
Tarcísio
• 83431 Tweets
Bears
• 81289 Tweets
Saints
• 79616 Tweets
Bills
• 78898 Tweets
Latinos
• 78770 Tweets
Commanders
• 74461 Tweets
Ravens
• 74127 Tweets
Lawson
• 64762 Tweets
Bad Bunny
• 62597 Tweets
Leclerc
• 58357 Tweets
Lando
• 53523 Tweets
Jameis
• 53385 Tweets
Dr. Phil
• 42449 Tweets
Raiders
• 41384 Tweets
Jayden Daniels
• 40877 Tweets
Hail Mary
• 35080 Tweets
Caleb
• 32503 Tweets
Porto Alegre
• 30281 Tweets
Rodgers
• 27756 Tweets
#GHDBT8
• 26590 Tweets
Seahawks
• 24817 Tweets
#HalloweenHavoc
• 16295 Tweets
Riestra
• 12507 Tweets
#RaiseHail
• 12348 Tweets
#CHIvsWAS
• 10289 Tweets
Last night we hosted Hack Night at
@github
with our friends from
@weaviate_io
@jamdotdev
and
@deepset_ai
and it was incredible!
Kudos to winners of the demo challenge for the demo hangman app they built on top of Neosync!
3
1
19
We're officially live on Hacker News! Check it out and give us an upvote!
0
6
15
Introducing our integration with
@PlanetScale
! You can now seed your development and staging databases with anonymized production data from your main branch or hydrate a dev database with synthetic data. Guide below!
0
5
15
Want to generate synthetic data for your
@neondatabase
database? We got you covered! Check out this guide on how you get integrate
@neosynccloud
with your Neon database and quickly seed your database with realistic synthetic data.
0
2
11
And we ain't stopping!
New changelog is out:
- more responsive error handling
- support for flexible schema references
- bug fixes
- UI refinements
and more!
Thank you to everyone on HN who upvoted our ShowHN, starred our repo and signed up for Neosync.
It's been great to see the community engagement.
This is just the beginning!
0
1
5
1
0
10
🚀 You can now generate data for any schema in Postgres or Mysql using
@neosynccloud
AI Data Generation.
We support pretty much every LLM that's available and even your own custom models.
As long as it's available at an endpoint, we can talk to it.
Neosync handles the
0
1
10
The first time a customer referred to us as a "Developer Data Platform", we didn't too much of it. Then a few more customers said it. Then a few investors said it. Then it became obvious that what we're building at Neosync is exactly just that: a data platform for developers.
1
2
8
New Blog Alert! We recently migrated from using SWR to using Tanstack +
@bufbuild
connectrpc for all of our react hooks and data fetching and it's massively simplified things. Check out the blog that
@NickZelei
published detailing how we did it.
0
5
8
We're looking better than ever with a brand new website! We spent some time updating our branding and messaging to more closely align with the problems we're solving.
Check it out!
0
1
8
Hack night day! Let's go!
Excited to host at GitHub w/
@jamdotdev
and our dev tools fam
@weaviate_io
@Haystack_AI
0
0
8
Heard of eBPF? It's growing like crazy and is the new kid on the block. Check out our blog where we break it down.
0
0
7
Yesterday we released the ability to use base transformers in Neosync custom transformers. Today, wanted to show off a demo of how you can use Neosync custom transformers to anonymize data and generate synthetic data. Check out the demo below!
0
0
7
Using Neosync to anonymize and sync production data from a source database to multiple destinations including object storage! In this demo, I show how easy it is to go from Postgres (prod) -> Postgres (stage) & S3.
1
4
7
Looking forward to working with Atli and the team at
@neondatabase
Very happy to announce
@neondatabase
partnering with
@neosynccloud
to create previews with anonymized production-like data in seconds. Quite a nice productivity improvement with the added benefit of data compliance!
0
1
7
0
2
7
@neondatabase
featured a blog by our co-founder
@evisdrenova
on their blog site. If you're looking for a wicked fast database to use and want to use synthetic data, check out our work with Neon!
1
3
7
New Changelog is out! Lots of new things shipped in the last two weeks.
1. Support for intra-table/inter-table circular dependencies
2. Data sync logs in the app for k8 deployments
3. Granular timeout settings
4. Support for private DBs
+ more!
0
1
7
We've officially hit 500 Github stars!
Help us get the next 500!
1
1
7
when an open source user finds a bug and then submits a PR to fix that bug
0
0
6
Super excited to announce that Neosync has been selected into
@TechCrunch
Startup Battlefield 200 at
#TechCrunchDisrupt2024
! Joining other alumni such as Cloudflare Discord Dropbox, we'll be presenting at Disrupt '24!
1
2
6
We just shipped support for Virtual Foreign Keys! VFKs are a great way to enforce relational integrity at the application layer while keeping your database relatively simple. Check it out ->
0
1
6
We're so excited to sponsor
#GopherCon
in Chicago this year. If you're attending, come stop by our booth and say hi to the team!
0
1
5
May was our busiest month yet across the board. We wrote a lot of code and shipped a lot of features.
Here's our May product update:
0
3
5
We recently published a blog on how to use
@neosynccloud
with
@neondatabase
and today we're publishing a quick demo showing you exactly how it's done. Check it out!
1
2
5
Neosync and
@OpenAI
.
A step by step guide.
Generate synthetic data and sync it across your Postgres or Mysql Databases.
🤯
0
0
5
Thank you to everyone on HN who upvoted our ShowHN, starred our repo and signed up for Neosync.
It's been great to see the community engagement.
This is just the beginning!
0
1
5
Excited that we've reached 400 stars on Github! We've got a lot of interesting things coming out soon from CTGAN support to LLM support to CSV support and more. Check us out and help us get to 500!
0
2
5
Want to hack on stuff AI tech? And win prizes?
Then join us!
We got the gang together to put on an awesome event at the
@github
HQ.
Come build cool stuff with us at Hack Night on March 26th at
@github
HQ in San Francisco.
Together with
@jamdotdev
and
@neosynccloud
, we’ll be building and learning, and there’s gonna be some exciting prizes for completing coding jams!
Register today:
2
2
7
1
0
5
Big news to start the week!
Super excited to announce that
@neosynccloud
is partnering with our friends at
@neondatabase
to give developers a complete solution to easily branch their Postgres databases with anonymized data for a better local developer experience. Read more below!
0
1
13
0
1
5
Excited to out and in the game. Check out what we're working on!
🚀 Launch Announcement🚀
I’m super excited to finally launch the open source project that we’ve been working on for the four months. Neosync is an open source data replication and anonymization pipeline designed to help developers create safe, anonymized test data and sync it
9
18
92
0
0
5
🚀 Excited to launch Custom Code Transformers on Neosync! Neosync ships with 40+ transformers that allow you to anonymize and generate synthetic data but sometimes you just need something more custom. And now you can.
0
1
5
We recently overhauled our subsetting features and added in new features that make it WAY easier to validate your subset queries and subset your data. Check out the video below and the blog post that goes in detail on how we built it!
0
0
4
BIG update. We published a Neosync Terraform provider! This was a highly requested features from our open source community and we're excited to ship it. Check out the launch blog!
0
0
4
Our vision is to bring Synthetic Data Engineering to the world. Read more below.
0
0
4
If you're using Postgres then you might have heard about PGAnonymizer. It's a pretty nifty tool to anonymize sensitive data. If you're not familiar with it, well then check out our latest blog!
0
1
4
New demo dropping!
Last week, we published a blog on how to generate synthetic data using
@neosynccloud
and
@OpenAI
.
You can use any LLM or model that is hosted at an endpoint.
Check out this 4-minute step by step guide on exactly how to do it!
0
0
4
Excited to announce that we published a public roadmap for
@Neosync
! Now you can see the features that we're working on in real-time and upvote what you'd like to see next. Check it out here!
1
1
4
We're really excited about this one! Co-founder and CTO
@NickZelei
is going to give a talk about how we use
@temporalio
to train and run ML models on synthetic data.
excited to share the next
@temporalio
meetup on feb 21 with headliner
@NickZelei
, cofounder & CTO of
@neosynccloud
!
want to use temporal to train ML models? want to learn how we built temporal cloud on temporal? join us! added bonus🍺 🍕
RSVP:
0
2
14
0
1
4
New blog is out! if you've ever inserted a row into a database then you've worked with referential integrity (even if you didn't know it). We explore referential integrity, why it's so important and how it comes to play in synthetic data.
0
1
4
New blog is out! We write about how we use Go Templates to auto-generate a lot of the documentation you see on . If you're using Go and you haven't explored Go templates, this blog is a great place to start!
New Blog is out! We go through how we use Go
0
2
4
We just shipped probably our most requested feature. Support for
@MongoDB
! You can now sync and anonymize data across MongoDB instances using Neosync. There's a lot more that we're going to be doing here but we're excited to ship v1. Check it out!
0
1
4
We're big fans of
@temporalio
and use it as a core part of the Neosync platform. In this blog, we talk about how we leverage Temporal for durable execution and to manage our workflows. Check it out!
1
1
4
"With the eclipse happening, I just wanted send a quick follow up about how we can eclipse your compliance burden with our AI synthetic data platform. Do you have time to chat?"
0
0
4
New Changelog is out! This changelog includes:
1. First class support for DynamoDB!
2. MYSQL Connections now have role permissions
3. Support subsetting within DynamoDB
4. Add auto-complete to custom javascript transformers
5. Improve MYSQL init schema options
+ much much more
0
0
3
Brand new changelog coming your way! We're working on some big changes coming in the next changelog but here's what we shipped!
- Usage metrics!
-
@supabase
integration!
- New streaming infrastructure!
+ more
0
0
3
525 🤯
525 engineers signed up for AI Hack Night tonight!
Super excited to host at GitHub w/ Jam and our dev tools fam
@weaviate_io
@neosynccloud
@Haystack_AI
See you there!
3
2
20
0
2
2
Consistency is a major requirement when working with data anonymization. If you have a transactional database and want to ensure that records that belong to the same user are anonymized in a consistent way then consistency comes into play. Check out this blog where we talk about
0
0
3
We're PUMPED to support
@GopherCon
. Our entire backend is written in GO and we can't imagine it any other way. Super excited to see everyone in Chicago!
0
0
3
It's Monday, so we're shipping new features! Introducing the Activity Timeline. The Activity Timeline provides a longitudinal view of all of the activities that ran within a job. Check out the demo for more!
0
0
3
New Changelog is out! A bunch of new updates across the entire stack. Here's what's new:
- Support primary key and foreign key transformations
- Update SSH tunnel session sharing to be much more efficient
- Add regular expression transformer
- UI/UX refinements
+ more!
0
1
2
📢 New Feature Alert!
Excited to release Partial Table Syncs. Now with
@neosynccloud
you can anonymize, generate and sync synthetic data for a subset of your schemas and tables while maintaining referential integrity and without breaking your table constraints.
Check out the
0
0
3
Changelog
#15
is out! Lots of new features in this one. Here's a quick overview:
- Added support for real time constraint validation
- Added root label to the subset page to denote root tables for subsetting
- Added button to get the row count of a subsetted table
- Added
0
1
3
👀 A sneak peek at what's coming very soon ... (like 80ms per call soon)
0
0
3
Metrics can be hard to come by for your open source project. After some research, we saw that
@github
had a surprising amount of information So we wrote a guide on what metrics Github offers and where to find them.
Check it out!
0
0
3
New Changelog is out! Here's are some highlights from this last sprint:
1. Integrate with any LLM to generate synthetic data for generate jobs
2. Transformers now filter by data type to prevent type mismatches
3. Self-service sign ups!
4. Reduced data generation time by 50%
+
0
0
2
We recently spent some time optimizing our data generation process and reduced our data generation times by 50%! We wrote a blog showing the benchmarks and the optimizations we implemented. Check it out!
0
0
2
PGAnonymizer is great for Postgres only deployments but what if you need orchestration, referential integrity, multiple destination syncing? Then check out our blog where we reviewed some alternatives to PGAnonymizer!
0
1
2
PGDUMP is one of the most widely used
@PostgreSQL
extensions. But do you know how it actually works? Check out this technical deep dive into the inner workings of PGDUMP!
0
1
2
Neosync's July product update is here!
Check out this blog for all of the latest product highlights from July. They include new integrations, new transformers and more!
0
0
1
Encryption, tokenization and synthetic data are similar but they're different tools with different use-cases. In our new blog, we take a look at the differences and similarities and use cases of all three. Check it out!
0
0
2
New changelog is out! Here's what we shipped in the last two weeks:
- AI Generated Synthetic Data(!)
- Subset table is now searchable and filterable
- Transform javascript transformer can now be used on foreign key columns
- Support for generated columns
and more!
Check it
0
0
2
Synthetic Data 🤝 JP Morgan
An interesting read on how JPMorgan generates and uses Synthetic data for their financial markets data
0
0
5
0
0
2
Just optimized our data generation and sync'ing pipelines to be 50% faster. AMA.
Benchmarks dropping later today.
0
0
2
New Changelog is out! Here's an overview of what we shipped over the holidays:
- Custom Code Transformer! (More on this tomorrow)
- Improved data sync performance by 30%
- New CLI commands
- Updated Compose file new production images
And more!
0
0
2
Every month in our product update, we post a meme of the month. This month:
0
1
1
New Changelog is out! Tons of DynamoDB upgrade, transformer updates and more. Check it out!
0
1
1
We recently shipped support for referential integrity in subsetting. This means respecting foreign keys + other constraints when you subset your data. If you like graph database problems then this blog is for you. Check it out!
0
0
1
Excited to ship this! We've been working with a few customers who use SQL Server and Neosync to replicate and anonymize prod data locally. Check it out!
0
0
1
Check out our new MongoDB docs that show you how to anonymize sensitive production data and sync it to your staging or dev database. Check it out below!
0
0
1
We've made trying Neosync 100x faster and easier by adding one feature. Now you can click 'Apply Default Transformers' to automatically map all of your columns in Neosync to a default transformer. What previously took 10 minutes, now takes 1 click.
0
1
1
Using RDS and want to generate synthetic data? Check out our latest guide on how to generate 1000s of rows of synthetic data in just a few seconds!
0
1
1
@lorenzejayTech
@github
@jamdotdev
@weaviate_io
@Haystack_AI
@itsajchan
Coulda really used this in college 👀
0
0
1
Two of the most popular anonymization techniques that companies are using to protect their sensitive data when training or fine-tuning LLMs are synthetic data generation and tokenization. In this blog, we deep-dive into both!
0
1
1
@awscloud
RDS is a relational database service used by thousands of companies. If you're using RDS and want to see how you can easily anonymize sensitive data and generate synthetic data, we wrote a guide on it!
0
0
1
One of the coolest demos from Hack Night was
@billiam0710
building a custom Transformer in Neosync that called ChatGPT to generate synthetic data for his
@neondatabase
database. LLM-powered synthetic data! This is all it took! This might also be a sneak peak at what we're
0
0
1