Skip to main content

Typesense Document ↔ batch import docs collection as .jsonl | CSV

default batchsize=40 to min RAM impact - set higher to ingest docs (and all other doc ops) faster

what batch_size limit to set for Fly App 256GB RAM limit? What happens when transient RAM util spikes to limit?

Typesense Document Schema

{
  "id": "1234", // UID num for doc
  "PARAM_1": "PARAM_1_VALUE",

convert JSON into JSONL via jq 

cat __docs.json | jq -c .[] \> __docs.jsonl
import docs as [JSONL](jsonl) via typesense API client
const documentsInJsonl = await fs.readFile("documents.jsonl");
client.collections('companies').documents().import(documentsInJsonl, {action: 'create', batch_size: 200});

References​