# DataJoint Documentation

> DataJoint is a Python framework for building scientific data pipelines with automated computation, integrity constraints, and seamless integration of relational databases with object storage.

> For the complete documentation in a single file, see [/llms-full.txt](/llms-full.txt)

## Concepts

- [Data Pipelines](/explanation/data-pipelines/)
- [FAQ](/explanation/faq/)
- [Relational Workflow Model](/explanation/relational-workflow-model/)
- [Entity Integrity](/explanation/entity-integrity/)
- [Normalization](/explanation/normalization/)
- [Computation Model](/explanation/computation-model/)
- [Schema as a Workflow Specification](/explanation/schema-as-workflow-specification/)
- [Comparison to Workflow Languages](/explanation/comparison-to-workflow-languages/)
- [Query Algebra](/explanation/query-algebra/)
- [Semantic Matching](/explanation/semantic-matching/)
- [Type System](/explanation/type-system/)
- [Custom Codecs](/explanation/custom-codecs/)
- [Spark Adapters](/explanation/spark-adapters/)
- [PostgreSQL CDC and Replica Identity](/explanation/postgresql-cdc-replication/)

## Tutorials

- [First Pipeline](/tutorials/basics/01-first-pipeline/)
- [Schema Design](/tutorials/basics/02-schema-design/)
- [Data Entry](/tutorials/basics/03-data-entry/)
- [Queries](/tutorials/basics/04-queries/)
- [Computation](/tutorials/basics/05-computation/)
- [Object Storage](/tutorials/basics/06-object-storage/)
- [University Database](/tutorials/examples/university/)
- [Hotel Reservations](/tutorials/examples/hotel-reservations/)
- [Languages & Proficiency](/tutorials/examples/languages/)
- [Fractal Pipeline](/tutorials/examples/fractal-pipeline/)
- [Blob Detection](/tutorials/examples/blob-detection/)
- [Calcium Imaging](/tutorials/domain/calcium-imaging/calcium-imaging/)
- [Electrophysiology](/tutorials/domain/electrophysiology/electrophysiology/)
- [Ephys with Object Storage](/tutorials/domain/electrophysiology/ephys-with-npy/)
- [Allen CCF](/tutorials/domain/allen-ccf/allen-ccf/)
- [SQL Comparison](/tutorials/advanced/sql-comparison/)
- [JSON Data Type](/tutorials/advanced/json-type/)
- [Distributed Computing](/tutorials/advanced/distributed/)
- [Custom Codecs](/tutorials/advanced/custom-codecs/)
- [Instances](/tutorials/advanced/instances/)

## How-To

- [Installation](/how-to/installation/)
- [Manage Secrets](/how-to/manage-secrets/)
- [Configure Database](/how-to/configure-database/)
- [Use Isolated Instances](/how-to/use-instances/)
- [Configure Object Storage](/how-to/configure-storage/)
- [Command-Line Interface](/how-to/use-cli/)
- [Define Tables](/how-to/define-tables/)
- [Model Relationships](/how-to/model-relationships/)
- [Master-Part Tables](/how-to/master-part/)
- [Design Primary Keys](/how-to/design-primary-keys/)
- [Read Diagrams](/how-to/read-diagrams/)
- [Manage Pipeline Project](/how-to/manage-pipeline-project/)
- [Deploy to Production](/how-to/deploy-production/)
- [Insert Data](/how-to/insert-data/)
- [Query Data](/how-to/query-data/)
- [Fetch Results](/how-to/fetch-results/)
- [Delete Data](/how-to/delete-data/)
- [Run Computations](/how-to/run-computations/)
- [Distributed Computing](/how-to/distributed-computing/)
- [Handle Errors](/how-to/handle-errors/)
- [Monitor Progress](/how-to/monitor-progress/)
- [Overview](/how-to/object-storage-overview/)
- [Choose Storage Type](/how-to/choose-storage-type/)
- [Use Object Storage](/how-to/use-object-storage/)
- [Staged Insert](/how-to/staged-insert/)
- [Use NPY Codec](/how-to/use-npy-codec/)
- [Use Plugin Codecs](/how-to/use-plugin-codecs/)
- [Create Custom Codecs](/how-to/create-custom-codec/)
- [Manage Large Data](/how-to/manage-large-data/)
- [Clean Up Storage](/how-to/garbage-collection/)
- [Migrate to 2.0](/how-to/migrate-to-v20/)
- [Alter Tables](/how-to/alter-tables/)
- [Backup and Restore](/how-to/backup-restore/)
- [Testing Best Practices](/how-to/testing/)

## Reference

- [Database Backends](/reference/specs/database-backends/)
- [Table Declaration](/reference/specs/table-declaration/)
- [Master-Part](/reference/specs/master-part/)
- [Virtual Schemas](/reference/specs/virtual-schemas/)
- [Query Operators](/reference/specs/query-algebra/)
- [Semantic Matching](/reference/specs/semantic-matching/)
- [Primary Keys](/reference/specs/primary-keys/)
- [Fetch API](/reference/specs/fetch-api/)
- [Diagram](/reference/specs/diagram/)
- [Types](/reference/specs/type-system/)
- [Codec API](/reference/specs/codec-api/)
- [NPY Codec](/reference/specs/npy-codec/)
- [SparkAdapter Protocol](/reference/specs/spark-adapter/)
- [Storage Adapter API](/reference/specs/storage-adapter-api/)
- [Data Manipulation](/reference/specs/data-manipulation/)
- [Staged Insert](/reference/specs/staged-insert/)
- [Cascade](/reference/specs/cascade/)
- [AutoPopulate](/reference/specs/autopopulate/)
- [Provenance Trace & Strict Provenance](/reference/specs/provenance/)
- [Job Metadata](/reference/specs/job-metadata/)
- [Object Store Configuration](/reference/specs/object-store-configuration/)
- [Deployment Operations](/reference/specs/deploy-operations/)
- [Thread-Safe Mode](/reference/specs/thread-safe-mode/)
- [Configuration](/reference/configuration/)
- [Definition Syntax](/reference/definition-syntax/)
- [Operators](/reference/operators/)
- [Errors](/reference/errors/)
- [Elements](/elements/)

- [API](/api/)

## About

- [What's New in 2.2.4](/about/whats-new-2-2-4/)
- [What's New in 2.2](/about/whats-new-22/)
- [What's New in 2.1](/about/whats-new-21/)
- [What's New in 2.0](/about/whats-new-2/)
- [History](/about/history/)
- [Documentation Versioning](/about/versioning/)
- [Citation](/about/citation/)
- [Publications](/about/publications/)
- [Contributing](/about/contributing/)