Bookmarks tagged “database”
28 bookmarks tagged “database”
Abusing SQLite to Handle Concurrency | SkyPilot Blog
SkyPilot uses the venerable SQLite for state management. SQLite can handle millions of QPS, and terabytes of data. However, our efforts to scale our Managed Jobs feature ran up against the one downfall of SQLite: many concurrent writers. Since SkyPilot typically runs as a CLI on
How bloom filters made SQLite 10x faster - blag
This is the fascinating story of how researchers used Bloom filters cleverly to make SQLite 10x faster for analytical queries. These are my five-minute notes on the paper SQLite: Past, Present, and Future
How to succeed as a data engineer without the burnout - Stack Overflow
From prototype to production: Vector databases in generative AI application
Bricolage | Some notes on Local-First Development
Local-first shifts reads and writes to client databases synced by engines. A major paradigm shift ahead.
What is a Vector Database? | Pinecone
Discover Vector Databases: How They Work, Examples, Use Cases, Pros & Cons, Selection and Implementation. They have combined capabilities of traditional databases and standalone vector indexes while specializing for vector embeddings.
Z-order indexing for multifaceted queries in Amazon DynamoDB: Part 2 | Amazon Web Services
In a previous AWS Database Blog post, I introduced Z-order indexing, a way in which you can sort your data to efficiently query an Amazon DynamoDB table by using range bounds on multiple attributes. In this post, we explore the process of creating a schema for your index. We look
Things You Should Know About Databases
How Relational Databases Work. This post talks about how indexes and transactions work on the inside of relational databases.
How sharding a database can make it faster - Stack Overflow Blog
What are SQL Joins? Types of SQL joins explained - DEV Community
This article was written by Christina Kopecky and was originally published at Educative, Inc. Str...
Improve database performance with connection pooling - Stack Overflow Blog
IO Block Size for SQL Server, Disk Block Size - Pure Storage
Check out this Pure Storage post to understand a bit more about SQL Server IO block sizes, as well as backups and restores.
Availability Group issues fixed with Alerts - Wayne Sheffield
Learn how to use the SQL Server Agent Alerting system to detect Availability Group issues and to respond to them by running jobs.
Row counts and arrow width, Compute Scalar - SQL Server Fast
This is the fifth and final post in my May 2020 series about the Actual and Estimated Number of Rows properties in execution plans. In the previous posts, I talked about how you can use them, the confusion a Nested Loops operator can cause, how sometimes the graphical representat
Did someone say BigQuery UDFs? I'll take 10! — Chris Tippett
If you're not already a fan of BigQuery's UDFs, you soon will be.
Things I Wished More Developers Knew About Databases
A large majority of computer systems have some state and are likely to depend on a storage system. My knowledge on databases accumulated over time, but along the way our design mistakes caused data…
NULL complexities – Part 1 - SQLPerformance.com
Itzik Ben-Gan kicks off a new series of Transact-SQL blog posts treating NULL handling in SQL Server.
GraphQL Search Indexing - Netflix TechBlog
Almost a year ago we described our learnings from adopting GraphQL on the Netflix Marketing Tech team. We have a lot more to share since then! There are plenty of existing resources describing how to…
Availability Groups and Redo Latency, Data Committed on a Primary isn’t Vis
If you’re running availability groups it may seem like a great idea to offload your read only reporting workloads to a secondary. There are a couple of ways that you could do that, you could …
The Log: What every software engineer should know about real-time data's un
I joined LinkedIn about six years ago at a particularly interesting time. We were just beginning to run up against the limits of our monolithic, centralized database and needed to start the transition to a portfolio of specialized distributed systems. This has been an interesting
How Postgres Makes Transactions Atomic
A dive into the mechanics that allow Postgres to provide strong atomic guarantees despite the chaotic entropy of production.
How Stack Overflow upgraded from Windows Server 2012
Warning: This post is long. While working through this massive server upgrade/migration process, tears were shed, many cuss words were said, along with a general feeling of frustration, which ultimately culminated into extreme happiness once the migration was completed. The scale