Developing your App
Primitive: Data Models
Introduction

Data Models Introduction

Data Models are foundational to your MooseJS application. Using Data Models, you define the schemas of the data you need to support in your application. Based on these simple schema definitions, MooseJS will configure end-to-end data infrastructure for you.

Data Models look like this:

datamodels/models.ts
type Key<T extends string | number> = T;
 
export interface UserActivity {
  eventId: Key<string>;
  timestamp: string;
  userId: string;
  activity: string;
}

For each Data Model that you define, MooseJS with automatically configure for you:

  • A typed SDK to instrument your upstream application(s) to capture data (currently supports Typescript only)
  • A high-performance ingestion API endpoint to receive data from upstream data sources (including, but not limited to the SDK mentioned above)
  • A streaming buffer to store data as it's ingested from the ingestion server, in order to handle peak load ingest without dropping any data on the ground
  • A landing table in the underlying OLAP analytics database to store ingested data
  • A database view to access and query the underlying data
  • A consumption API endpoint to pull data into downstream applications (coming soon)
  • A typed SDK to use in your downstream application(s) to easily consume data from the API endpoint (coming soon)
    •

    All of these components are typed to the schema of your Data Model, and automatically configured to be interconnected and to pass data seamlessly down the pipeline.

    In other words, simply by defining a couple simple Data Model primitives, you can be up and running with a modern, scalable, end-to-end data stack in just a couple minutes. You're ready to start ingesting data from data sources, building Flows to process that data, and consuming that data into downstream use cases like BI software, LLMs, or your own analytics-driven applications.

    In the following documentation you’ll find information about:

  • How to create and inspect your Data Models
  • How to ingest data into your MooseJS applications (via Data Models)
  • How to consume data from your MooseJS applications (via Data Models)
  • How to build Flows that transform data from one Data Model to another Data Model
  • How modify and manage versions of your Data Models with Data Change Management
    • ArchitectureUsing Data Models