DuckDB
@duckdb
Followers
13,963
Following
3
Media
145
Statuses
702
DuckDB is an analytical in-process SQL database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
Amsterdam, The Netherlands
Joined May 2019
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
松野さん
• 140139 Tweets
松野太紀さん
• 114818 Tweets
金田一少年の事件簿
• 68937 Tweets
万丈目さん
• 61654 Tweets
#happyZNNxTaoKaeNoi
• 59067 Tweets
スポンジボブ
• 52733 Tweets
ANDAM JURY ROSÉ
• 52657 Tweets
ホームラン
• 50463 Tweets
#映画よめぼく
• 49685 Tweets
ZeeNuNew x TKN
• 38312 Tweets
JAEMIN 1ST PHOTO EXHIBITION
• 32848 Tweets
#初星学園HR
• 24793 Tweets
サヨナラ
• 24612 Tweets
VLOG 2 WITH BUILD
• 21111 Tweets
Razem
• 18348 Tweets
#baystars
• 18279 Tweets
#素のまんま
• 14174 Tweets
一ちゃん
• 11548 Tweets
اليابان
• 11303 Tweets
Pinned Tweet
We are proud to release the first major version of DuckDB, v1.0.0, codenamed "Snow Duck".
This version is a culmination of almost six years of research and development. Today we are shipping an innovative database system with a backwards-compatible storage format.
Check out our
23
284
1K
New blog post by
@mraasveldt
: Multi-Database Support in DuckDB
DuckDB can now attach MySQL, Postgres, and SQLite databases in addition to databases stored in its own format. This allows data to be read into DuckDB and moved between these systems in a
10
85
364
DuckDB was recently covered in
@andy_pavlo
's Advanced Database Systems course at CMU. The lecture covers DuckDB's history, internals, and integration with other systems.
Slides:
Recording:
1
70
362
We are proud to release DuckDB v0.10.0:
Some highlights:
– A reworked and much faster CSV reader
– Fixed-length arrays
– Multi-database support
– Secrets manager
– Temporary memory manager
– Adaptive lossless floating-point compression
– New CLI editor
–
1
63
273
DuckDB 0.7.0 "Labradorius" released with
#JSON
support, parallel and partitioned export to CSV and Parquet, UPSERT,
@DataPolars
integration, and much more in our release announcement blog post:
9
52
266
We wrote a performance guide for DuckDB users! This guide covers topics such as the effects of schema (constraints, indexing) and hardware (CPU, memory, disk). We also share best practices for querying Parquet files and tips for tuning your workload.
1
47
226
New blog post: Access 150k+ Datasets from Hugging Face with DuckDB
This blog post, co-authored by the
@huggingface
and DuckDB teams, describes how you can use the hf:// prefix in DuckDB to access datasets in Hugging Face repositories.
Read more at
4
57
226
DuckDB has introduced native Delta Lake support.
In our new blog post,
@samansmink
walks through the design and implementation of the new Delta Lake extension.
Read more at
6
39
222
We just released DuckDB 0.9.0 "Undulata", check out our release announcement blog post:
2
43
211
DuckDB's co-creator, Hannes Mühleisen, recently became a professor of data engineering at Radboud University. The recording of his inaugural lecture, titled "The Ancient Art of Data Management", is now available.
1
29
183
New blog post by
@szarnyasg
:
Command Line Data Processing: Using DuckDB as a Unix Tool
This blog post shows how DuckDB stacks up against classic Unix tools (such as cut, grep, sort, and sed) when performing simple data processing steps.
Read more at
1
55
185
DuckDB 0.6.0 "Oxyura" released with improved storage, higher performance for CSV loading and indexing, new SQL syntax, better memory management, shell tweaks and so many new features
@mraasveldt
wrote a separate blog post to explain it all:
4
41
170
DuckDB supports querying buckets in the AWS S3 Express One Zone. Read the related guide at , which shows that DuckDB can read a Parquet file from an S3 Express One bucket at about 1.2 gigabytes per second!
PS: You may also noticed that we started rolling
1
33
154
DuckDB 0.5.0 "Pulchellus" released with persistent indexes, out-of-core hash join, new join order optimizer, and many other improvements
1
29
149
New blog post by
@pdet
: DuckDB ADBC - Zero-Copy data transfer via Arrow Database Connectivity
0
28
145
The DuckDB repository hit 15,000 stars on GitHub today. Thanks to our contributors and our amazing community!
0
5
144
New blog post by
@__AlexMonahan__
SQL Gymnastics: Bending SQL into flexible new shapes
In this post, Alex presents pure SQL queries to implement dynamic groupings and aggregate functions using DuckDB's friendly SQL extensions. The queries can be used to
2
25
143
We have revamped one of our core operators, aggregation. It has improved scalability for many unique groups and for a large number of cores. Thanks to these, you can expect better performance when running large aggregations on big machines.
1
19
141
The Awesome DuckDB repository, maintained by
@davidgasquez
, has grown to more than 100 entries in less than a year. If you are aware of more cool projects using DuckDB, please consider submitting a PR!
2
28
140
Did you know that you can connect to a DuckDB database file via HTTPS or S3 with just two SQL statements? We have a new guide that explains how to do this.
2
18
137
New blog post by
@hfmuehleisen
duckplyr: dplyr powered by DuckDB
The post describes the new R package duckplyr, which translates the dplyr API to DuckDB’s execution engine.
Read more at
1
37
137
There are now a lot of handy tools and cool projects built around DuckDB. You can find a list of these in the Awesome DuckDB repository maintained by
@davidgasquez
.
See the list and contribute your project at
1
30
129
DuckDB 0.8.0 "Fulvigula" released, check out our release announcement blog post:
4
37
126
This blog post by Cal Paterson (), "DuckDB Isn't Just Fast", discusses some of DuckDB's characteristics outside of sheer processing speed: developer ergonomics, scalability using out-of-core processing, and ease of setup.
0
18
125
New blog post: JupySQL enables SQL cells in Jupyter, supports DuckDB, and also enables plotting larger than memory datasets using DuckDB! JupySQL is an active fork of ipython-sql being enhanced by the folks at
@ploomber
. Let us know what you think!
4
23
122
DuckDB reached 10 000 stars on GitHub:
3
9
120
The new DuckDB landing page, , has several code snippets for SQL features and DuckDB's APIs. You can use the "Live Demo" button to execute the queries on an example dataset in your browser using the DuckDB shell that runs in WebAssembly.
Note: the demo
1
18
119
DuckDB's documentation is now available for offline use both as a PDF and as a ZIP archive, which contains the static HTML of the website.
Head to to grab a copy.
3
10
119
The R package for DuckDB v1.0.0 is out on CRAN! Run install.packages("duckdb") to upgrade.
0
21
116
We released DuckDB v1.0.0 a week ago.
There is a growing list of tools integrating with DuckDB, applications that use DuckDB, and extensions created for DuckDB. You can find a list of these in the Awesome DuckDB repository, maintained by
@davidgasquez
.
The list is never
1
18
115
We have started publishing the recordings of DuckCon
#4
. We are first releasing the “State of the Duck” talk by DuckDB's co-creators, Hannes Mühleisen (
@hfmuehleisen
) and Mark Raasveldt (
@mraasveldt
).
Video:
Slides:
Special thanks
2
21
113
The DuckDB team celebrates yesterday’s release, v0.10.0, with a custom-made yoghurt cake! 🍰
2
4
111
Lambda functions are one of the most popular features in DuckDB. We recently added list_reduce, a new scalar function that supports lambdas, and they got their own documentation page at .
Note that this feature is currently only available in DuckDB's
0
16
106
DuckDB just got a tldr page. If you have
@tldr_pages
installed, you can get examples of the most common command-line arguments with:
$ tldr duckdb
0
21
105
Congratulations to
@motherduck
on launching their DuckDB-powered cloud data warehouse in General Availability! 🎉
MotherDuck, the ducking simple data warehouse, is now Generally Available! 🍾🥂 Thank you to our community of thousands of users who have tested, validated, and helped improve MotherDuck over the last year.❤️🦆
5
44
186
3
10
107
Did you know that DuckDB's documentation is available as a single PDF? It includes all documentation pages and guides, and just surpassed 1,000 pages.
2
15
103
New blog post by
@carlo_piovesan
: Extensions for DuckDB-Wasm
Thanks to recent developments, DuckDB-Wasm users can now load DuckDB extensions, allowing them to run extensions in the browser.
2
31
102
DuckDB was included in
@InfoWorlds
's best open-source software list as a "tiny-but-powerful project" that provides just enough OLAP for most use cases. The award praised the lightweight nature and many features of DuckDB.
The best open source software of 2023 Ready to discover more? Click the image below ⬇️
0
2
9
2
19
100
This blog post is a short summary of the ICDE 2024
(
@icdeconf
) paper authored by
@lnkuiper
,
@peterabcz
, and
@hfmuehleisen
: Robust External Hash Aggregation in the Solid State Age.
The paper is available at
0
20
98
Did you know that you can use DuckDB to query Google Sheets via its CSV export? This blog post at areca data explains how:
2
16
97
New blog post by Richard Wesley: Range Joins in DuckDB
2
20
96
New blog post by
@holanda_pe
– DuckDB's CSV Sniffer: Automatic Detection of Types and Dialects
3
13
96
2
22
91
DuckDB can both export to and import from Numpy arrays. We added two new guides to cover these features:
5
15
95
DuckDB's co-creator
@hfmuehleisen
announced support for Delta Lake (
@DeltaLakeOSS
) in DuckDB at last week's
@Data_AI_Summit
.
You can rewatch the keynote segment below:
For more information, see the delta extension's documentation:
1
11
97
DuckDB's co-creator
@hfmuehleisen
will give a keynote tomorrow at
@GOTOamst
.
Hannes, who is also a professor of data engineering at
@Radboud_Uni
, will give an overview of the last decades of data management, discuss why relational systems are still prevailing, and why
2
13
94
We rolled out an updated syntax highlighter and a new color scheme in the DuckDB documentation, .
The highlighter now knows all of DuckDB's keywords and functions. The color scheme is based in the Bluloco theme ().
2
11
91
New blog post by
@szarnyasg
:
Analyzing Railway Traffic in the Netherlands
This tutorial demonstrates some of DuckDB's key query features using datasets that capture the railway traffic in the Netherlands.
3
18
91
New blog post by Richard Wesley – DuckDB's AsOf Joins: Fuzzy Temporal Lookups
0
16
89
Did you know that DuckDB supports function chaining? This allows function calls to be rewritten in more a readable manner. See the Even Friendlier SQL with DuckDB blog post for details:
0
13
89
As promised just 1.5 weeks ago, we have indeed released DuckDB v1.0.0 this summer ☀️
4
13
84
“With DuckDB as a browser for the data cloud, relational datasets are always just a hyperlink away.” – That's a great line. Thanks for this nice blog post,
@NikolasGoebel
!
2
5
82
0
31
82
We have released DuckDB v0.10.3, a bugfix release.
The command 'pip install duckdb --upgrade' already delivers the new version. DuckDB clients in other package management systems (CRAN, Maven, Homebrew, etc.) will be updated in the coming days.
For the release notes and binary
2
15
81
DuckDB's co-creator
@mraasveldt
gave a talk about DuckDB Internals at
@andy_pavlo
's Advanced Databases Course at CMU this week:
0
13
80
DuckDB 0.4.0 "Ferruginea" released with query cancellation on CTRL-C and parallelism for most queries
0
22
78
We created a single, easy-to-search PDF file from the DuckDB documentation:
This is a preview version – if you find any issues, please report them at
0
17
78
Team DuckDB is giving a talk and running a booth
@PydataEindhoven
today. Drop by for some swag!
2
5
72
0
4
73
🚨 A reminder for our old users and a pointer to our new followers: the DuckDB CLI client has a tldr page.
If you have
@tldr_pages
installed, you can get examples of the most common command line arguments with:
$ tldr duckdb
0
8
72
New blog post by
@pdet
“
@DuckDB
quacks
@ApacheArrow
: A zero-copy data integration between Arrow and DuckDB”
0
26
72
We extended our performance guide with a new recommendation: avoid joining on VARCHAR-typed columns (i.e., strings). The accompanying microbenchmark demonstrates a case where performing a large join on BIGINT columns is 2.6× faster than evaluating the same join on VARCHAR
2
9
69
New guest post by
@matsonj
:
#ModernDataStack
in a Box with DuckDB (includes
@meltanodata
,
@dbt_labs
,
@apachesuperset
, with contributions from
@__AlexMonahan__
and
@josh_wills
)
2
14
68
#DuckCon
lightning talk recordings:
"
@lakeFS
❤️ DuckDB" by
@ozkatz100
"Using DuckDB and ArrowFlight to Power a Feature Store" by
@tdoehmen
from
@hopsworks
"Integrating DuckDB with
@fluvio_io
" by Sehyo Chang
0
18
63
Next release 0.5.0 is planned for 2022-09-05, major changes, now would be a good time to test with the latest master branch and report issues if any.
2
9
63
Today's keynote at the
@Data_AI_Summit
will (again) feature DuckDB co-creator
@hfmuehleisen
, who will talk about DuckDB's support for Delta Lake (
@deltalakeoss
).
Follow the live stream (starting at 8.30am Pacific Time, in approximately half an hour):
1
13
62
DuckCon
#4
will feature a talk by
@polinaeterna
of
@huggingface
titled “Hugging a Duck: democratizing data access and exploration with DuckDB and Hugging Face Hub”.
The talk will explain how they use DuckDB to allow people to easily explore over 250k public dataset on the
0
13
61
DuckDB 0.3.3 "Sansaniensis" released with JSON extension,
@JuliaLanguage
API, S3 enhancements and much more:
2
19
62
We just released DuckDB v0.10.2, a bugfix release.
See the installation page and the release notes for details:
–
–
1
8
59
A reminder: DuckDB has a tldr page. If you have
@tldr_pages
installed, you can get examples of the most common command-line arguments by running
$ tldr duckdb
0
9
60
0
22
59
New blog post: Parallel Grouped Aggregation in DuckDB
0
12
59
We have released DuckDB v0.10.1, a bugfix release. For installation instructions, see:
This release fixes several issues with the CSV parser and tackles scenarios which previously resulted in out-of-memory (OOM) errors (details in 🧵).
1
12
57
DuckDB's DevRel,
@szarnyasg
, gave a talk last November at the
@oredev
conference titled "DuckDB: Harnessing in-process analytics for data science and beyond". The recording is now available:
The slide deck is here:
0
7
56
A new DuckDB article is out on Datanami with quotes from
@hfmuehleisen
:
DuckDB Walks to the Beat of Its Own Analytics Drum
“DuckDB has this different angle,” Mühleisen said. “It’s more like something that you put into a workflow rather than something
0
9
54
We have released DuckDB v0.9.1 today. This is a bug fix release for various issues discovered after we released 0.9.0. There are no new features, just bug fixes. Database files created by DuckDB v0.9.0 can be read by DuckDB v0.9.1.
1
11
56
Laurens Kuiper will present his paper "Robust External Hash Aggregation in the Solid State Age" tomorrow at ICDE 2024 in Utrecht. This work describes the techniques that make larger-than-memory aggregation possible in DuckDB. The paper is co-authored by Peter Boncz (
@peterabcz
)
0
10
54
3
5
56
