Skip to main content

Orchestration / ETL

Capabilities

Version:
IDTitleDescriptionThreat Mappings
CCC.ETL.CP01Batch ProcessingSupports the processing of bounded (batch) data sources using a consistent programming model or engine.
0
CCC.ETL.CP02Stream ProcessingSupports the processing of unbounded (streaming) data sources using a consistent programming model or engine.
0
CCC.ETL.CP03Schema EvolutionAutomatically detects source data structures and manages changes in schema (e.g., column additions) over time without pipeline failure.
0
CCC.ETL.CP04Distributed Data ShufflingProvides an internal service to re-partition and group data across distributed workers for complex operations like joins and aggregations.
0
CCC.ETL.CP05Windowing and Event-Time ProcessingEnables grouping of data based on time attributes, supporting tumbling, hopping, and session windows with late-data handling (watermarking).
0
CCC.ETL.CP06Change Data Capture (CDC) IntegrationSupports incremental data ingestion by tracking changes in source transaction logs rather than full table scans.
0
CCC.ETL.CP07Connectivity and Connector LibraryProvides pre-built, managed connectors for a variety of sources and sinks (e.g., Object Storage, RDBMS, NoSQL, Pub/Sub).
0
CCC.ETL.CP08Job BookmarksPersists the state of a processing job (e.g., checkpointing or bookmarks) to ensure exactly-once processing and fault tolerance.
0
CCC.ETL.CP09Pushdown OptimizationThe ability to translate transformation logic into the native language of the source or sink (e.g., SQL) to minimize data movement.
0
CCC.ETL.CP10Visual OrchestrationProvides a graphical interface to define dependencies between extraction, transformation, and loading tasks.
0
CCC.ETL.CP11Data Lineage & Metadata TrackingCaptures and exports metadata regarding the data sources, the transformation steps, and the final destination (sink), showing the flow from source to destination for compliance and debugging.
0
CCC.ETL.CP12User-Defined Function (UDF) SupportAllows developers to inject custom logic (Python, Java, SQL) into the managed processing pipeline for complex transformations.
0
CCC.ETL.CP13Time-Based Job TriggeringSupports time-based (cron) mechanisms to initiate data processing workflows.
0
CCC.ETL.CP14Event Based Job TriggeringSupports event-based (file arrival) mechanisms to initiate data processing workflows.
0

Imports

IDRemarks
CCC.Core.CP01Encryption in Transit
CCC.Core.CP02Encryption at Rest
CCC.Core.CP03Access Log Publication
CCC.Core.CP06Access control
CCC.Core.CP07Event Publication
CCC.Core.CP09Metrics Publication
CCC.Core.CP10Log Publication
CCC.Core.CP14API Access
CCC.Core.CP18Resource Versioning
CCC.Core.CP20Resource Tagging
CCC.Core.CP23Network Access Rules
CCC.Core.CP28Command-line Interface
CCC.Core.CP29Active Ingestion
CCC.Core.CP31Elastic Scaling