News
Dev DB: A Zero-Setup Database for Faster Local Development
8+ hour, 47+ min ago (841+ words) Starting a new project should be simple. Clone the repository, install dependencies, run the app, and start building. But in many PHP projects, developers often need to complete several extra steps before they can even see the first page: For…...
Granular Usage Attribution for dbt Pipelines with Query Tags
12+ hour, 45+ min ago (701+ words) Tag, track, and optimize every dbt model " from cost attribution and performance debugging to environment monitoring " with a single line of configuration or Genie. by Heeren Sharma, Lennart Reschke and Joo Ho Yeo With'Query Tags (now in Public Preview), data…...
Today I got a very painful reminder of the importance of using transactions in database migrations.
18+ hour, 17+ min ago (11+ words) A post by Andrea Mancuso. Tagged with backend, database, devjournal, sql....
Stop Guessing Batch Sizes: High-Performance Bulk Inserts in Spring Boot with Postgre SQL COPY
20+ hour, 30+ min ago (826+ words) When you can't afford to guess the right batch size and don't want to pay for that lesson in production When I designed the persistence layer of a real-time interbank settlement pipeline, I had a problem that many financial systems…...
What Analytics Engineering Is and Why Teams Invest in It
22+ hour, 48+ min ago (625+ words) An analytics engineer's core responsibility is building and maintaining the data models that sit between raw source data and the dashboards and tools that consume it. In practice, this means writing and organizing transformation logic, usually in SQL using a…...
Your Disk Is Full but `du` Says It's Empty
1+ day, 52+ min ago (1331+ words) Your server is slow. You check the disk: Ninety-five gigabytes used. So you go looking for what's eating it: Add it all up and you get maybe 25 gigabytes. So where are the other 70? You can't find the files. You can't…...
"Couldn't you just use pg_activity? " staking out one corner of Postgres incident triage"
1+ day, 52+ min ago (1004+ words) Earlier, I wrote about a 2 a. m. incident. Production is slow, you open psql, the cursor blinks, and your hand freezes on the very first query. I introduced pgincident as a tool that breaks that "first-response paralysis" by giving you the whole…...
TIL: Postgresql's SUBSTRING function
1+ day, 1+ hour ago (160+ words) Today I needed to group records by a substring contents of one of the columns. We have data like task_type: "Facade (S4)", so this should be grouped as belonging to group 4 (from S4). Turns out there's a simple and powerful way to do…...
How Small Postgres Metadata Tables Quietly Throttle Your Largest Queries | Hacker Noon
1+ day, 5+ hour ago (882+ words) A 10, 000-row device metadata table, rarely updated, sitting in the'FROM'clause of every dashboard query you run, can drag your entire time-series query path into the wrong performance tier. The time-series scan looks fast in'EXPLAIN. The join node is where the…...
How I Engineered a 1. 7 M Row Product Safety Database to Serve Pages in 66ms on a Single Free VM
1+ day, 3+ hour ago (762+ words) Let me tell you what happens when you shove 1. 7 million dense Postgre SQL rows onto a 6 GB ARM instance and then try to serve real user traffic. That's where Lemon Knows started " a consumer safety and food intelligence platform tracking…...