Squirreling SQL Engine

Squirreling is a streaming async SQL engine for JavaScript. It is designed to provide efficient streaming of results from pluggable backends for highly efficient retrieval of data for browser applications.

Features

• Lightweight and fast
• Easy to integrate with frontend applications
• Lets you move query execution closer to your users
• Supports standard SQL queries
• Async streaming for large datasets
• Constant memory usage for simple queries with LIMIT
• Robust error handling and validation designed for LLM tool use
• In-memory data option for simple use cases
• Late materialization for efficiency
• Select only

Usage

Squirreling returns an async generator, allowing you to process rows one at a time without loading everything into memory.

import { executeSql } from 'squirreling'

// In-memory table
const users = [
  { id: 1, name: 'Alice', active: true },
  { id: 2, name: 'Bob', active: false },
  { id: 3, name: 'Charlie', active: true },
  // ...more rows
]

type AsyncRow = Record<string, AsyncCell>
type AsyncCell = () => Promise<SqlPrimitive>

// Returns an async iterable of rows with async cells
const asyncRows: AsyncIterable<AsyncRow> = executeSql({
  tables: { users },
  query: 'SELECT count(*) as cnt FROM users WHERE active = TRUE LIMIT 10',
})

// Process rows as they arrive (streaming)
for await (const { cnt } of asyncRows) {
  console.log('Count', await cnt())
}

There is an exported helper function collect to gather all rows into an array if needed:

import { collect, executeSql } from 'squirreling'

// Collect all rows and cells into a materialized array
const allUsers: Record<string, SqlPrimitive>[] = await collect(executeSql({
  tables: { users },
  query: 'SELECT * FROM users',
}))
console.log(allUsers)