Running the workers
The workers must be running if you want clients to interact with integrations.
They are the middlemen executing the desired tasks. As detailed in the "How it
operator are two
workers running different kind of tasks:
- The loader is in charge of Loading data asynchronously into integrations. This worker is necessary if you leverage Blacksmith for ETL.
- The operator is in charge of running operations, queries, and migrations synchronously against SQL integrations and leverages a remote mutex for handling access locks. This worker is necessary if you leverage Blacksmith for SQL operations and migrations.
In addition to
rely the following environment variables to properly work:
The default namespace
Before starting the workers, let's create the
default namespace with a retention
period of 14 days:
$ blacksmith namespaces create \ --name default \ --retention 336h Managing namespaces: -> Creating namespace default... Success!
Note that the retention passed is a duration in minutes or hours. Working with days can be confusing for several reasons as explained in the guides dedicated to namespaces.
default is now registered in the server. The workers that will be
started next will be dedicated to this namespace only.
Starting the workers
loader execute the tasks for Loading data into integrations. You
can start this worker with:
$ blacksmith start worker loader
operator execute the tasks for running queries against SQL databases
such as operations and migrations. You can start this worker with:
$ blacksmith start worker operator
Now that the server and workers are up and running, let's dive into some details to help you discover Blacksmith step-by-step.
If you notice something we've missed or could be improved on, please follow this link and submit a pull request to the repository. Once we merge it, the changes will be reflected on the website the next time it is deployed.
Thank you for your contributions!