Skip to main content

TDP Datacenter

Prerequisites
  • Operating System: Windows 10 or higher, or Linux with VirtualBox 7 or higher
  • Processor: 4 vCPUs available
  • RAM: 10 GB available
  • Available disk space: Initially 100 GB, potentially expanding to 140 GB
  • VirtualBox installed and configured

What is the TDP Datacenter Sandbox?​

The TDP Datacenter Sandbox is a pre-configured virtual machine that emulates a single-node TDP Datacenter cluster. It allows you to quickly and easily explore — primarily for study or testing — functionalities such as:

  • Data ingestion and transformation.
  • Data pipeline execution.
  • Integration testing with analytical tools.

This solution is ideal for developers, data analysts, and administrators who want to experiment with or test some of the advanced data transformation, processing, and analysis features before implementing them in production, without the complexity of a full installation.

This guide will help you with importing, configuring, accessing, and using the TDP Datacenter Sandbox.

Importing the Sandbox​

Follow the instructions below to import and start the Sandbox:

  1. Download the Sandbox (.ova file) using the Tecnisys Public Package Repository.

    In the Tecnisys Public Package Repository, the Sandbox files are available in the /sandbox/tdp/ directory.

    Figure 1 - Tecnisys Public Package Repository
    Figure 1 - Tecnisys Public Package Repository
    note

    .ova files follow the pattern => sandbox-tdp-xxx-nnn-ova, where:

    • xxx - TDP version (e.g., 230)
    • nnn - sequential number (e.g., 001)

  2. Import the TDP sandbox image:

    2.1. Open VirtualBox. 2.2. In the top menu, click File → Import Appliance.

    Figure 2 - Importing the .ova file
    Figure 2 - Importing the .ova file

    2.3. In the window that opens, select the Sandbox .ova file you downloaded. 2.4. Click Finish to start importing the virtual machine (VM) image.

    Figure 3 - Importing the .ova file
    Figure 3 - Importing the .ova file

    2.5. Accept the license agreement by clicking I Agree.

    Figure 4 - Accepting the terms and conditions of the license agreement
    Figure 4 - Accepting the terms and conditions of the license agreement

    2.6. Wait for the VM image import to complete.

    2.7. Start the imported VM.

    Figure 5 - Virtual Machine Initialization
    Figure 5 - Virtual Machine Initialization

    2.8. Wait for the VM to start and display the customized initial screen.

    2.9. The Sandbox is ready to use!

    Figure 6 - SandBox ready to use
    Figure 6 - SandBox ready to use

  3. Configure the Sandbox name resolution:

    When using a local VM for testing and studies, it's recommended to map the VM's domain locally. This configuration facilitates access to the environment, enables port forwarding, and more realistically simulates a production environment, eliminating dependency on external DNS servers.

    3.1. Configure the hosts file on the local host (Windows or Linux), associating the IP 127.0.0.1 with the Sandbox hostname (FQDN) (sandbox-tdp<MAJOR VERSION><MINOR VERSION>.tecnisys.com.br). For example: sandbox-tdp23.tecnisys.com.br.

    note

    The hosts file is a local configuration file present in operating systems such as Windows (C:/Windows/System32/drivers/etc/hosts) and Linux (/etc/hosts). It serves to resolve domain names to IPs, eliminating the need to query an external DNS server.

    3.1.a. Configuring the hosts file on Linux.

    3.1.a.1. Open the hosts file with a text editor of your choice. In this tutorial, we use vi:

    Terminal input
        sudo vi /etc/hosts

    3.1.a.2. Add a new line at the end of the file (in vi, press G to go to the end of the file and i to insert a new line) with the resolution of the IP 127.0.0.1 to the Sandbox hostname. Note that after the IP, you should specify the hostname with the domain (FQDN), followed by a space, and then just the hostname. See the example below for the TDP 2.3 Sandbox:

    Terminal input
        127.0.0.1 sandbox-tdp23.tecnisys.com.br sandbox-tdp23

    3.1.a.3. Save and close the file (in vi, press ESC and type :wq).

    3.1.b. Configuring the hosts file on Windows.

    3.1.b.1. Open Notepad as Administrator.

    tip

    Right-click on the Notepad icon and select Run as Administrator.

    3.1.b.2. In Notepad, open the file C:/Windows/System32/drivers/etc/hosts.

    3.1.b.3. Add a new line at the end of the file with the resolution of the IP 127.0.0.1 to the Sandbox hostname. Note that after the IP, you should specify the hostname with the domain (FQDN), followed by a space, and then just the hostname. See the example below for the TDP 2.3 Sandbox:

    Terminal input
        127.0.0.1 sandbox-tdp23.tecnisys.com.br sandbox-tdp23

    3.1.b.4. Save the file.

    Figure 7 - Modifying the hosts file in Windows
    Figure 7 - Modifying the hosts file in Windows

Accessing the TDP Cluster​

Once the VM is running, use the browser or terminal to interact with the TDP cluster services in the Sandbox.

Sandbox Home Page​

  1. Open your browser and access the Sandbox Home page through the following URL:

    http://localhost:42080

    If you have locally added a name resolution for the Sandbox VM, use the hostname defined in the hosts file. For example, for the TDP 2.3 Sandbox:

    http://sandbox-tdp23.tecnisys.com.br:42080

  2. On the Sandbox Home page, we have the Quick Links area for quick access to the web interfaces of TDP Cluster components. Select the card of the desired component to view the access URL and credentials.

    Figure 8 - Sandbox Home Page
    Figure 8 - Sandbox Home Page

Starting TDP Cluster Services​

Through the Sandbox Home page, access the Apache Ambari web interface, the centralized administration component of the TDP platform, to start TDP Cluster services such as Apache Kafka, Apache NiFi, Trino, among others.

warning

Avoid starting too many services at once, as this can lead to performance issues and instability on a local VM with limited computational resources.

  1. On the Apache Ambari login screen, enter the credentials below to access:

    • Username: admin
    • Password: admin

  2. Select the service of interest in the left sidebar menu.

  3. Start all service components by clicking the Actions → Restart All button located in the upper right corner.

    Figure 9 - Start service
    Figure 9 - Start service

Accessing the Sandbox via SSH​

Through a terminal, you can access the Sandbox by establishing an SSH connection on port 2122 of the VM:

Terminal input
    ssh -p 2122 devopstdp@localhost

Access Credentials​

Below are the access credentials for users previously created in the Sandbox VM:

UsuárioSenha
roottecnisystdp23
sandboxtecnisystdp23
devopstdptecnisystdp23

The following are the main access credentials of the TDP Cluster services in the Sandbox:

ServiçoUsuárioSenha
Airflowadmintecnisystdp23
Ambariadminadmin
Druid Database Userdruiddruid
Grafanaadmintecnisystdp23
Hive Database Userhivehive
Kafka UIkafka-uitecnisystdp23
Rangeradmintecnisystdp23
Ranger Admin Credentials for Ambariamb_ranger_admintecnisystdp23
Ranger Database Userrangerranger

The following are the sensitive property values of the TDP Cluster services in the Sandbox:

ServiçoPropriedadeValor
KnoxMaster Secrettecnisystdp23
NiFiCA Tokentecnisystdp23
NiFiEncryption Passwordtecnisystdp23
NiFiRegistry Encryption Passwordtecnisystdp23
NiFiSensitive property values encryption passwordtecnisystdp23
RangerUsersync User's Passwordtecnisystdp23
RangerTagsync User's Passwordtecnisystdp23
SupersetSECRET_KEYtecnisystdp23
SupersetSuperset Admin Emailadmin@tecnisys.com.br
SupersetSuperset Admin Firstnameadmin
SupersetSuperset Admin Lastnametecnisys
SupersetSuperset Admin Passwordtecnisystdp23

Communication Ports​

The table below lists the services and their respective communication ports used in the Sandbox. This configuration allows access to services hosted on the virtual machine.

ApplicationPort
Ambari8080
Apache42080
Datanode50075
Atlas21000
Grafana3000
Druid Router8888
Druid Coordinator8081
HBaseMaster16010
HBaseRegion16030
HDFS8020
HiveJDBCJar10002
HostSSH2122
HostSSH2200
JobHistory19888
Kafka8079
Knox8443
NiFi9090
NiFi Registry61080
NodeManager8042
Nodemanager8040
ResourceManager8032
Infra Solr8886
Solr Admin8983
SparkHistoryServer18082
WebHBase60080
Ranger50070
Ranger6080
YARN8088
YarnATS8188
Zeppelin9995
Superset9088
AirflowUI18080
CeleryFlowerUI5555
Trino5555

Use this table to access and configure services as needed.

warning

If your local machine is already using any of the ports configured for the Sandbox, the VM will not start, and VirtualBox will present an error during the process, aborting execution.