Skip to main content
Version Next

About TDP Kubernetes​

TDP Kubernetes is the cloud-native edition of the Tecnisys Data Platform, designed for deployments on Kubernetes clusters. This edition uses Helm Charts for packaging and ArgoCD for GitOps, offering:

  • Declarative deployment via Helm Charts
  • Automated GitOps with ArgoCD
  • Elastic resource scalability
  • Native integration with the Kubernetes ecosystem
  • Simplified configuration management
  • Multi-environment support (development, staging, production, etc.)

TDP-K8s deployment is modular and flexible. It orchestrates several essential components across the data lifecycle:

  • Distributed processing: Apache Spark and Trino.
  • Streaming and ingestion: Apache Kafka (Strimzi) and Apache NiFi.
  • Storage and metadata: Hive Metastore, PostgreSQL (metadata database) and Apache Iceberg.
  • Orchestration: Apache Airflow.
  • Analytical storage: ClickHouse.
  • Object storage: Apache Ozone.
  • Governance and security: OpenMetadata and Apache Ranger.
  • Visualization and BI: Apache Superset.
  • Interface and administration: JupyterHub and CloudBeaver.
Figure — TDP Kubernetes general architecture. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD apply configuration to the cluster; data persists in external storage; components are accessed via Gateway API.
Figure — TDP Kubernetes general architecture. Helm Charts and Docker images are stored in the Artifact Registry; TDPCTL or ArgoCD apply configuration to the cluster; data persists in external storage; components are accessed via Gateway API.

Cloud-Native Architecture​

TDP Kubernetes adopts a microservices architecture, where each Big Data ecosystem component runs in containers managed by Kubernetes. Helm Charts encapsulate all deployment complexity, while ArgoCD ensures continuous synchronization between the desired state (Git) and the actual cluster state.

New Components​

This edition includes components exclusive to Kubernetes:

  • ClickHouse: High-performance columnar OLAP database
  • CloudBeaver: Web interface for database administration
  • Kubernetes: Container orchestration and workload management

Use Cases​

This edition is ideal for:

  • Public cloud deployments (AWS, GCP and Azure)
  • On-premise Kubernetes environments
  • Cloud-native and microservices architectures
  • Organizations adopting DevOps and GitOps practices
  • Workloads requiring dynamic scalability
  • Multi-tenant environments

Helm Charts Registry​

TDP Kubernetes Helm Charts are available in the Tecnisys private registry:

https://registry.tecnisys.com.br

To obtain access credentials, contact Tecnisys support.