Overview
IntegrationsPricing

Invincible and self-managed ETL / ELT

« Blacksmith is a powerful solution to manage your ETL / ELT integrations. It's a great alternative to Airflow for your modern data stack. Configure your data pipeline with a few YAML lines and stay focus on your business logic. »
Aurélien Aubert — Engineering Team Lead @Spendesk(opens in a new tab or window)

Survive anything

Blacksmith provides hard guarantees around the durability of data and seamlessly deals with long-running operations, retries, and intermittent failures.

Scale easily

Scalability is another crucial advantage of using Blacksmith for data processing. It automatically distributes data and workload demand across workers.

Deploy everywhere

Blacksmith works on any machine and any cloud to respect organizational, technical, and legal requirements your organization or customers might have.

ETL / ELT from any language Coming soon

Extract and Load data from existing applications using the language of your choice.

Discover our SDKs
blacksmith.Load(data);

Load & Transform with SQL

Execute statements against any SQL database within a transaction for managing analytical operations, such as refreshing views.

Read guide about running operations
Manage your data pipeline using SQL with Blacksmith

ETL / ELT with
YAML / JSON

Extraction from SQL Change Data Capture

Capture row changes from SQL INSERT,UPDATE, and DELETE on any and every tables.

sources:
  - name: "my-source"
    defaults:
      cdc:
        driver: "postgresql"
        connection: "ANY_ENV_VAR"
    triggers:
      - name: "my-trigger"
        config:
          cdc:
            channel: "users"

Extraction from subscriptions

Connect to message brokers with support for AWS SQS, Azure Service Bus, Google Pub / Sub, Kafka, NATS, and RabbitMQ.

sources:
  - name: "my-source"
    defaults:
      subscription:
        driver: "kafka"
    triggers:
      - name: "my-trigger"
        config:
          subscription:
            topic: "<topic>"
            queue: "<consumer-group>"

Extraction from webhooks

Capture events from third-party services by using webhooks within a few lines of configuration.

sources:
  - name: "my-source"
    defaults:
      http_endpoint:
        prefix: "/mysource"
    triggers:
      - name: "my-trigger"
        config:
          http_endpoint:
            method: "POST"
            endpoint: "/endpoint"

Extraction from web services

Request HTTP services on a CRON schedule and Extract the data returned by the API.

sources:
  - name: "my-source"
    defaults:
      http_client:
        base_url: "https://api.example.com"
    triggers:
      - name: "my-trigger"
        config:
          http_client:
            method: "POST"
            endpoint: "/endpoint"

ETL / ELT is only one of the data
engineering components.

Invincible ETL / ELT

Extract, Transform, and Load any kind of data across any kind of systems with confidence.

Databases operations

Load & Transform data within multiple SQL databases leveraging the native dialect of each one.

Databases migrations

Version, run, rollback, and discard migrations across multiple SQL databases.

Data engineering
delivered at your scale

Blacksmith comes in two Editions to give you the flexibility to operate reliable data engineering solutions at your scale.