Skip to main content

Sandbox TDP

Prerequisites
  • Operating System: Windows 10 or higher, or Linux with VirtualBox 7 or higher
  • Processor: 4 vCPUs available
  • RAM: 10 GB available
  • Available disk space: Initially 100 GB, potentially expanding to 140 GB
  • VirtualBox installed and configured

What is the TDP Sandbox?​

The TDP Sandbox is a pre-configured virtual machine that emulates a single-node TDP cluster. It allows you to explore, in a limited way, functionalities such as:

  • Data ingestion and transformation.
  • Data pipeline execution.
  • Integration testing with analytical tools.

This solution is ideal for developers, data analysts, and administrators who want to experiment with or test some of the advanced data transformation, processing, and analysis features before implementing them in production.

This guide will help you with importing, configuring, accessing, and using the TDP Sandbox.

Importing the TDP Sandbox​

Follow the instructions below to import and start the TDP Sandbox:

  1. Download the sandbox image (.ova file) using the Tecnisys Public Package Repository.

    In the Tecnisys Public Package Repository, the sandbox images are available in the /sandbox/tdp/ directory.

    Figure 1 - Tecnisys Public Package Repository
    Figure 1 - Tecnisys Public Package Repository

  2. Import the TDP sandbox image:

    2.1. Open VirtualBox. 2.2. In the top menu, click File → Import Appliance (or use the shortcut Ctrl + I).

    Figure 2 - Importing the .ova file
    Figure 2 - Importing the .ova file

    2.3. In the window that opens, select the TDP sandbox .ova file you downloaded. 2.4. Click Finish to start importing the virtual machine (VM) image.

    Figure 3 - Importing the .ova file
    Figure 3 - Importing the .ova file

    2.5. Accept the TDP Sandbox license agreement by clicking I Agree.

    Figure 4 - Accepting the terms and conditions of the license agreement
    Figure 4 - Accepting the terms and conditions of the license agreement

    2.6. Wait for the VM image import to complete.

    2.7. Start the imported VM.

    Figure 5 - Virtual Machine Initialization
    Figure 5 - Virtual Machine Initialization

    2.8. Wait for the VM to start and display the customized initial screen.

    2.9. The TDP Sandbox is ready to use!

    Figure 6 - SandBox ready to use
    Figure 6 - SandBox ready to use

  3. Configure the TDP Sandbox name resolution:

    When using a local VM for testing and studies, it's recommended to map the VM's domain locally. This configuration facilitates access to the environment, enables port forwarding, and more realistically simulates a production environment, eliminating dependency on external DNS servers.

    3.1. Configure the hosts file on the local host (Windows or Linux), associating the IP 127.0.0.1 with the sandbox hostname (FQDN) (sandbox-tdp<MAJOR VERSION><MINOR VERSION>.tecnisys.com.br). For example: sandbox-tdp23.tecnisys.com.br.

    note

    The hosts file is a local configuration file present in operating systems such as Windows (C:/Windows/System32/drivers/etc/hosts) and Linux (/etc/hosts). It serves to resolve domain names to IPs, eliminating the need to query an external DNS server.

    3.1.a. Configuring the hosts file on Linux.

    3.1.a.1. Open the hosts file with a text editor of your choice. In this tutorial, we use vi:

    Terminal input
        sudo vi /etc/hosts

    3.1.a.2. Add a new line at the end of the file (in vi, press G to go to the end of the file and i to insert a new line) with the resolution of the IP 127.0.0.1 to the sandbox hostname. Note that after the IP, you should specify the hostname with the domain (FQDN), followed by a space, and then just the hostname. See the example below for the TDP 2.3 Sandbox:

    Terminal input
        127.0.0.1 sandbox-tdp23.tecnisys.com.br sandbox-tdp23

    3.1.a.3. Save and close the file (in vi, press ESC and type :wq).

    3.1.b. Configuring the hosts file on Windows.

    3.1.b.1. Open Notepad as Administrator.

    tip

    Right-click on the Notepad icon and select Run as Administrator.

    3.1.b.2. In Notepad, open the file C:/Windows/System32/drivers/etc/hosts.

    3.1.b.3. Add a new line at the end of the file with the resolution of the IP 127.0.0.1 to the sandbox hostname. Note that after the IP, you should specify the hostname with the domain (FQDN), followed by a space, and then just the hostname. See the example below for the TDP 2.3 Sandbox:

    Terminal input
        127.0.0.1 sandbox-tdp23.tecnisys.com.br sandbox-tdp23

    3.1.b.4. Save the file.

    Figure 7 - Modifying the hosts file in Windows
    Figure 7 - Modifying the hosts file in Windows

Accessing the TDP Cluster​

Once the VM is running, use the browser or terminal to interact with the TDP Sandbox services.

Sandbox Home Page​

  1. Open your browser and access the TDP Sandbox Home page through the following URL:

    http://localhost:42080

    If you have locally added a name resolution for the TDP Sandbox VM, use the hostname defined in the hosts file. For example, for the TDP 2.3 Sandbox:

    http://sandbox-tdp23.tecnisys.com.br:42080

  2. On the Sandbox Home page, we have the Quick Links area for quick access to the web interfaces of TDP Cluster components. Select the card of the desired component to view the access URL and credentials.

    Figure 8 - TDP Sandbox Home Page
    Figure 8 - TDP Sandbox Home Page

Starting TDP Cluster Services​

Through the TDP Sandbox Home page, access the Apache Ambari web interface, the centralized administration component of the TDP platform, to start TDP Cluster services such as Apache Kafka, Apache NiFi, Trino, among others.

warning

Avoid starting too many services at once, as this can lead to performance issues and instability on a local VM with limited computational resources.

  1. On the Apache Ambari login screen, enter the credentials below to access:

    • Username: admin
    • Password: admin

  2. Select the service of interest in the left sidebar menu.

  3. Start all service components by clicking the Actions → Restart All button located in the upper right corner.

    Figure 9 - Start service
    Figure 9 - Start service

Accessing the Sandbox via SSH​

Through a terminal, you can access the TDP Sandbox by establishing an SSH connection on port 2122 of the VM:

Terminal input
    ssh -p 2122 devopstdp@localhost

Access Credentials​

Below are the access credentials for users previously created in the TDP Sandbox VM:

UsuárioSenha
roottecnisystdp23
sandboxtecnisystdp23
devopstdptecnisystdp23

The following are the main access credentials of the TDP Cluster services:

ServiçoUsuárioSenha
Airflowadmintecnisystdp23
Ambariadminadmin
Druid Database Userdruiddruid
Grafanaadmintecnisystdp23
Hive Database Userhivehive
Kafka UIkafka-uitecnisystdp23
Rangeradmintecnisystdp23
Ranger Admin Credentials for Ambariamb_ranger_admintecnisystdp23
Ranger Database Userrangerranger

The following are the sensitive property values of the TDP Cluster services:

ServiçoPropriedadeValor
KnoxMaster Secrettecnisystdp23
NiFiCA Tokentecnisystdp23
NiFiEncryption Passwordtecnisystdp23
NiFiRegistry Encryption Passwordtecnisystdp23
NiFiSensitive property values encryption passwordtecnisystdp23
RangerUsersync User's Passwordtecnisystdp23
RangerTagsync User's Passwordtecnisystdp23
SupersetSECRET_KEYtecnisystdp23
SupersetSuperset Admin Emailadmin@tecnisys.com.br
SupersetSuperset Admin Firstnameadmin
SupersetSuperset Admin Lastnametecnisys
SupersetSuperset Admin Passwordtecnisystdp23

Communication Ports​

The table below lists the services and their respective communication ports used in the TDP Sandbox. This configuration allows access to services hosted on the virtual machine.

ApplicationPort
Ambari8080
Apache42080
Datanode50075
Atlas21000
Grafana3000
Druid Router8888
Druid Coordinator8081
HBaseMaster16010
HBaseRegion16030
HDFS8020
HiveJDBCJar10002
HostSSH2122
HostSSH2200
JobHistory19888
Kafka8079
Knox8443
NiFi9090
NiFi Registry61080
NodeManager8042
Nodemanager8040
ResourceManager8032
Infra Solr8886
Solr Admin8983
SparkHistoryServer18082
WebHBase60080
Ranger50070
Ranger6080
YARN8088
YarnATS8188
Zeppelin9995
Superset9088
AirflowUI18080
CeleryFlowerUI5555
Trino5555

Use this table to access and configure services as needed.

warning

If your local machine is already using any of the ports configured for the Sandbox, the VM will not start, and VirtualBox will present an error during the process, aborting execution.