fix(influxdb3): Cleanup processing engine:
- Add separate Manage Dependencies heading - Move external plugins for better flow\ - Remove dupespull/6217/head
Jason Stirnaman
parent
d971aa340f
commit
cdc5f0ad9a
|
|
@ -15,7 +15,9 @@ The plugin API lets you:
|
|||
|
||||
## Get started with the shared API
|
||||
|
||||
Each plugin automatically has access to the shared API through the `influxdb3_local` object. You don’t need to import any libraries. The API becomes available as soon as your plugin runs.
|
||||
Each plugin automatically has access to the shared API through the `influxdb3_local` object. You don't need to import any libraries. The API becomes available as soon as your plugin runs.
|
||||
|
||||
If your plugin requires third-party Python packages (like `pandas`, `requests`, or `influxdb3-python`), see [Manage plugin dependencies](/influxdb3/version/plugins/#manage-plugin-dependencies) for installation instructions.
|
||||
|
||||
## Write data
|
||||
|
||||
|
|
|
|||
|
|
@ -25,7 +25,7 @@ Once you have all the prerequisites in place, follow these steps to implement th
|
|||
- [Set up the Processing Engine](#set-up-the-processing-engine)
|
||||
- [Add a Processing Engine plugin](#add-a-processing-engine-plugin)
|
||||
- [Set up a trigger](#set-up-a-trigger)
|
||||
- [Advanced trigger configuration](#advanced-trigger-configuration)
|
||||
- [Manage plugin dependencies](#manage-plugin-dependencies)
|
||||
{{% show-in "enterprise" %}}
|
||||
- [Distributed cluster considerations](#distributed-cluster-considerations)
|
||||
{{% /show-in %}}
|
||||
|
|
@ -99,16 +99,11 @@ Visit the [influxdb3_plugins repository](https://github.com/influxdata/influxdb3
|
|||
|
||||
#### Add example plugins
|
||||
|
||||
You can either copy a plugin or retrieve it directly from the repository:
|
||||
You have two options for using example plugins:
|
||||
|
||||
{{< code-tabs-wrapper >}}
|
||||
##### Option 1: Copy plugins locally
|
||||
|
||||
{{% code-tabs %}}
|
||||
[Copy locally](#)
|
||||
[Fetch via gh:](#)
|
||||
{{% /code-tabs %}}
|
||||
|
||||
{{% code-tab-content %}}
|
||||
Clone the `influxdata/influxdb3_plugins` repository and copy plugins to your configured plugin directory:
|
||||
|
||||
```bash
|
||||
# Clone the repository
|
||||
|
|
@ -117,23 +112,25 @@ git clone https://github.com/influxdata/influxdb3_plugins.git
|
|||
# Copy a plugin to your configured plugin directory
|
||||
cp influxdb3_plugins/examples/schedule/system_metrics/system_metrics.py /path/to/plugins/
|
||||
```
|
||||
{{% /code-tab-content %}}
|
||||
|
||||
{{% code-tab-content %}}
|
||||
|
||||
##### Option 2: Reference plugins directly from GitHub
|
||||
|
||||
Skip downloading plugins by referencing them directly from GitHub using the `gh:` prefix:
|
||||
|
||||
```bash
|
||||
# To retrieve and use a plugin directly from GitHub,
|
||||
# use the `gh:` prefix in the plugin filename:
|
||||
# Create a trigger using a plugin from GitHub
|
||||
influxdb3 create trigger \
|
||||
--trigger-spec "every:1m" \
|
||||
--plugin-filename "gh:examples/schedule/system_metrics/system_metrics.py" \
|
||||
--database my_database \
|
||||
system_metrics
|
||||
--trigger-spec "every:1m" \
|
||||
--plugin-filename "gh:examples/schedule/system_metrics/system_metrics.py" \
|
||||
--database my_database \
|
||||
system_metrics
|
||||
```
|
||||
|
||||
{{% /code-tab-content %}}
|
||||
This approach:
|
||||
|
||||
{{< /code-tabs-wrapper >}}
|
||||
- Ensures you're using the latest version
|
||||
- Simplifies updates and maintenance
|
||||
- Reduces local storage requirements
|
||||
|
||||
Plugins have various functions such as:
|
||||
|
||||
|
|
@ -489,91 +486,9 @@ influxdb3 create trigger \
|
|||
auto_disable_processor
|
||||
```
|
||||
|
||||
## Advanced trigger configuration
|
||||
## Manage plugin dependencies
|
||||
|
||||
After creating basic triggers, you can enhance your plugins with these advanced features:
|
||||
|
||||
### Access community plugins from GitHub
|
||||
|
||||
Skip downloading plugins by referencing them directly from GitHub:
|
||||
|
||||
```bash
|
||||
# Create a trigger using a plugin from GitHub
|
||||
influxdb3 create trigger \
|
||||
--trigger-spec "every:1m" \
|
||||
--plugin-filename "gh:examples/schedule/system_metrics/system_metrics.py" \
|
||||
--database my_database \
|
||||
system_metrics
|
||||
```
|
||||
|
||||
This approach:
|
||||
|
||||
- Ensures you're using the latest version
|
||||
- Simplifies updates and maintenance
|
||||
- Reduces local storage requirements
|
||||
|
||||
### Configure your triggers
|
||||
|
||||
#### Pass configuration arguments
|
||||
|
||||
Provide runtine configuration to your plugins:
|
||||
|
||||
```bash
|
||||
# Pass threshold and email settings to a plugin
|
||||
Provide runtime configuration to your plugins:
|
||||
--trigger-spec "every:1h" \
|
||||
--plugin-filename "threshold_check.py" \
|
||||
--trigger-arguments threshold=90,notify_email=admin@example.com \
|
||||
--database my_database \
|
||||
threshold_monitor
|
||||
```
|
||||
|
||||
Your plugin accesses these values through the `args` parameter:
|
||||
|
||||
```python
|
||||
def process_scheduled_call(influxdb3_local, call_time, args=None):
|
||||
if args and "threshold" in args:
|
||||
threshold = float(args["threshold"])
|
||||
email = args.get("notify_email", "default@example.com")
|
||||
|
||||
# Use the arguments in your logic
|
||||
influxdb3_local.info(f"Checking threshold {threshold}, will notify {email}")
|
||||
```
|
||||
|
||||
#### Set execution mode
|
||||
|
||||
Choose between synchronous (default) or asynchronous execution:
|
||||
|
||||
```bash
|
||||
# Allow multiple trigger instances to run simultaneously
|
||||
influxdb3 create trigger \
|
||||
--trigger-spec "table:metrics" \
|
||||
--plugin-filename "heavy_process.py" \
|
||||
--run-asynchronous \
|
||||
--database my_database \
|
||||
async_processor
|
||||
```
|
||||
|
||||
Use asynchronous execution when:
|
||||
|
||||
- Processing might take longer than the trigger interval
|
||||
- Multiple events need to be handled simultaneously
|
||||
- Performance is more important than sequential execution
|
||||
|
||||
#### Configure error handling
|
||||
|
||||
Control how your trigger responds to errors:
|
||||
```bash
|
||||
# Automatically retry on error
|
||||
influxdb3 create trigger \
|
||||
--trigger-spec "table:important_data" \
|
||||
--plugin-filename "critical_process.py" \
|
||||
--error-behavior retry \
|
||||
--database my_database \
|
||||
critical_processor
|
||||
```
|
||||
|
||||
### Install Python dependencies
|
||||
|
||||
Use the `influxdb3 install package` command to add third-party libraries (like `pandas`, `requests`, or `influxdb3-python`) to your plugin environment.
|
||||
This installs packages into the Processing Engine’s embedded Python environment to ensure compatibility with your InfluxDB instance.
|
||||
|
|
|
|||
Loading…
Reference in New Issue