mirror of
https://github.com/NVIDIA-NeMo/DataDesigner
synced 2026-05-24 09:48:29 +00:00
44 lines
1.6 KiB
Markdown
44 lines
1.6 KiB
Markdown
|
# Engine Processor Implementations
|
||
|
|
|
||
|
|
Runtime processor classes and processor registry helpers.
|
||
|
|
|
||
|
|
Plugin processors inherit from [Processor](#data_designer.engine.processing.processors.base.Processor) and override one or more callback methods: `process_before_batch`, `process_after_batch`, or `process_after_generation`.
|
||
|
|
|
||
|
|
For user-facing processor config objects, see [processor configurations](../config/processors.md).
|
||
|
|
|
||
|
|
## Base Contract
|
||
|
|
|
||
|
|
### `Processor` {#data_designer.engine.processing.processors.base.Processor}
|
||
|
|
|
||
|
|
::: data_designer.engine.processing.processors.base.Processor
|
||
|
|
options:
|
||
|
|
show_root_toc_entry: false
|
||
|
|
|
||
|
|
## Built-In Implementations
|
||
|
|
|
||
|
|
### `DropColumnsProcessor` {#data_designer.engine.processing.processors.drop_columns.DropColumnsProcessor}
|
||
|
|
|
||
|
|
::: data_designer.engine.processing.processors.drop_columns.DropColumnsProcessor
|
||
|
|
options:
|
||
|
|
show_root_toc_entry: false
|
||
|
|
|
||
|
|
### `SchemaTransformProcessor` {#data_designer.engine.processing.processors.schema_transform.SchemaTransformProcessor}
|
||
|
|
|
||
|
|
::: data_designer.engine.processing.processors.schema_transform.SchemaTransformProcessor
|
||
|
|
options:
|
||
|
|
show_root_toc_entry: false
|
||
|
|
|
||
|
|
## Registry
|
||
|
|
|
||
|
|
### `ProcessorRegistry` {#data_designer.engine.processing.processors.registry.ProcessorRegistry}
|
||
|
|
|
||
|
|
::: data_designer.engine.processing.processors.registry.ProcessorRegistry
|
||
|
|
options:
|
||
|
|
show_root_toc_entry: false
|
||
|
|
|
||
|
|
### `create_default_processor_registry` {#data_designer.engine.processing.processors.registry.create_default_processor_registry}
|
||
|
|
|
||
|
|
::: data_designer.engine.processing.processors.registry.create_default_processor_registry
|
||
|
|
options:
|
||
|
|
show_root_toc_entry: false
|