index.mdx - docs -

index.mdx (2308B)
      1 ---
      2 title: "OSMA (Open Source Module Archive)"
      3 sidebarTitle: "OSMA"
      4 ---
      5 
      6 import Copyright from "/snippets/copyright.mdx";
      7 
      8 **Registry lookups, without the wait.** OSMA is a lightning-fast, static search archive for querying open-source packages across NPM and PyPI, bypassing live registry bottlenecks.
      9 
     10 ## Why it exists
     11 
     12 Looking up package details on the official registries usually means dealing with:
     13 
     14 1. **Fastly security checks** — CAPTCHAs or verification screens just to view a text page
     15 2. **The multi-click tax** — clicking through 2-3 pages just to find a version tag or repo link
     16 
     17 **The fix:** complete static snapshots of both registries were taken — **NPM at 2026-04-29 09:42 IST**, **PyPI at 2026-04-29 08:45 IST** — and indexed into a custom backend. This lets you instantly search and verify packages without ever hitting a live registry rate limit. Clicking a package in the UI still fetches its extended live details securely via a side-panel.
     18 
     19 ## Live explorers & docs
     20 
     21 - **Home:** [data.amit.is-a.dev](https://data.amit.is-a.dev)
     22 - **NPM Explorer:** [data.amit.is-a.dev/npm](https://data.amit.is-a.dev/npm)
     23 - **PyPI Explorer:** [data.amit.is-a.dev/pypi](https://data.amit.is-a.dev/pypi)
     24 - **API Docs (live):** [data.amit.is-a.dev/docs](https://data.amit.is-a.dev/docs)
     25 
     26 ## How the backend works
     27 
     28 The backend runs on **FastAPI**, serving static `.csv` snapshots pulled securely from HuggingFace datasets.
     29 
     30 - **SQLite indexing** — on first boot, the server downloads the multi-gigabyte dataset and builds an optimized, indexed SQLite database (WAL mode)
     31 - **Speed** — because the dataset is localized, `/search` and `/browse` respond in milliseconds
     32 - **Rate limiting** — strict limits (10 requests/minute, 100/hour) protect the free-tier infrastructure, enforced via `slowapi`; developers can request an `X-Bypass-Token` via a GitHub issue
     33 - **Ranking logic** — search results are ranked `0` exact match → `1` starts with query → `2` contains query
     34 - **Limitation** — as a frozen archive, packages published or deleted after April 2026 aren't indexed
     35 
     36 ## Get started
     37 
     38 - [Quick Start](/osma/quickstart)
     39 - [NPM API Reference](/osma/npm-api)
     40 - [PyPI API Reference](/osma/pypi-api)
     41 - [Utility Endpoints](/osma/utility)
     42 - [Notes, Limits & FAQ](/osma/notes)
     43 
     44 <Copyright />