DIA Nexus Documentation
  • Nexus Overview
  • Intro to Nexus
    • How it works
    • Nexus vs. Lumina
    • Integrated Chains
  • Data products
    • Token Price Feeds
    • RWA Price Feeds
    • Randomness
    • Fair-value Feeds
  • How-to Guides
    • Fetch Price Data
      • Solidity
      • Vyper
      • Demo Oracles
      • Chain-specific Guide
        • Aleph Zero
        • Alephium
        • Edu Chain
        • Hydration
        • Kadena
        • LUKSO
        • Somnia
        • Stacks
        • Superseed
        • XRP Ledger (XRPL)
    • Generate Randomness
      • Solidity
      • WASM
      • Demo Oracles
      • Chain-specific Guide
        • Alephium
    • Migrate to DIA
    • Fund the Oracle
    • Build a Scraper
      • Development Cluster Stack
      • DIA Test‐Space with Docker Compose
      • DIA Test‐Space with Minikube
      • Add a new exchange scraper
      • Add a new foreign scraper
      • Add a new liquidity scraper
      • Additional notes
  • Request a Custom Oracle
  • Reference
    • Architecture
      • Data sourcing
      • Data computation
      • Data delivery
    • APIs
      • Token prices
        • RestAPI
          • Request Samples
        • GraphQL
          • Request Samples
      • RWA prices
    • Pricing Methodologies
      • IR: Interquartile Range Filter
      • MAIR: Moving Average with Interquartile Range Filter
      • VWAP: Volume Weighted Average Price
      • VWAPIR: Volume Weighted Average Price with Interquartile Range Filter
      • LST fair price
    • Data Sources
      • CEXes Data
      • DEXes Data
    • Smart Contracts
      • DIAOracleV2.sol
      • DIARandomOracle.sol
    • Randomness Protocol
  • Resources
    • Audits
    • Community & Support
    • Security Bounty Program
    • Research
      • Return Rates in Crypto Farming
      • Crypto Volatility Index
      • Compounded Rates
      • Polkadot Medianizer
    • T&C
      • Licence Agreement
      • Contributor Covenant Code of Conduct
      • Disclaimer
Powered by GitBook
On this page
  • Preparing the local files
  • Preparing a local cluster
  • Other useful commands
Export as PDF
  1. How-to Guides
  2. Build a Scraper

DIA Test‐Space with Minikube

Developing, Testing, and Building the DIA platform with Minikube

PreviousDIA Test‐Space with Docker ComposeNextAdd a new exchange scraper

Last updated 2 months ago

Preparing the local files

  1. Clone repo and change directory:

git clone git@github.com:diadata-org/diadata.git
cd diadata

Preparing a local cluster

Note: Minikube runs on a virtualization layer on the host. The driver is usually the recommended and default option and should be seen as a requirement. For other supported drivers, please refer to . You can also check for advanced command usage.

  1. First, install dependencies: and .

  2. Next, start the development environment by running the following command to start a Minikube node:

./testenv.sh start
  1. Build the necessary service containers by executing the following commands:

./testenv.sh build
  1. Run the installation script to set up the necessary services (Redis cache, Kafka streams, PostgreSQL, and InfluxDB databases) by executing the following commands:

./testenv.sh install

Now that you have the local cluster running, you are ready to start.

  1. import the test data from the diadata snapshot service: This requires the default structure to be empty and created inside the postgres server. The script will automatically download the snapshot, install it and remove the downloaded snapshot again.

./testenv.sh snapshot

Other useful commands

To stop the cluster:

./testenv.sh stop

To delete the cluster node:

./testenv.sh delete
docker
Minikube's official documentation
Minikube's handbook
Minikube
Docker