Using Teradata TdBench to generate and load 300GB TPC-H data set on Azure

In this video, we walk through downloading, installing, configuring, and using Teradata TdBench 7.2 to generate and load 1GB and 300GB TPC-H data sets into Teradata Database (Developer Tier) deployed from Azure Marketplace.

Video Walkthrough

Tip: Play the video full screen.

Table of Contents

00:00 — Teradata TdBench 7.2 on Azure
02:36 — TdBench configuration
04:46 — Validate TdBench user
05:27 — Run tdb.sh
07:01 — Create tpch1g database
09:44 — Install Teradata Tools (tdload)
11:39 — Re-run data load
12:31 — Data load finished
13:21 — Create tpch300g database
14:17 — View iostat during data generation
15:16 — Data gen of 300G finished
16:50 — Load 300GB of files into tpch300g database
19:39 — Use Viewpoint to see tables being loaded
20:26–300GB data load finished
22:36 — Start serial TPC-H queries
23:34 — iostat during query execution
25:31 — View TdBench Result Tables
27:23 — Viewing results of 300GB serial run

Teradata TdBench 7.2

Create tpch1g database

CREATE DATABASE tpch1g AS PERM=10e9 SPOOL=10e9 TEMPORARY=10e9;
GRANT ALL ON tpch1g TO av_Benchmark WITH GRANT OPTION;

Check perm space used

SELECT 
DatabaseName,
SUM(CurrentPerm) As Used
FROM DBC.DiskSpace
WHERE DatabaseName = 'tpch1g'
GROUP BY DatabaseName;

Create tpch300g database

CREATE DATABASE tpch300g AS PERM=750e9 SPOOL=300e9 TEMPORARY=300e9;
GRANT ALL ON tpch300g TO av_Benchmark WITH GRANT OPTION;

Check perm space used

SELECT 
DatabaseName,
SUM(CurrentPerm) As Used
FROM DBC.DiskSpace
WHERE DatabaseName = 'tpch1g'
GROUP BY DatabaseName;

Add more perm space

MODIFY DATABASE tpch1g AS PERM = 10e9;

Run serial TPC-H commands to check empty tables

./tdbench.sh
exec scripts/tpch300g_serial.cmd

Run TPC-H data load command

./tdbench.sh
exec scripts/tpch300g_load.cmd

TdBench result tables

SELECT * FROM av_Benchmark.TestTracking;
SELECT * FROM av_Benchmark.RptTestDetail WHERE RUNID = 6;

Thank you!

Please leave feedback and questions below or on Twitter https://twitter.com/ArsenVlad

Image for post

Originally published at blogs.msdn.microsoft.com on December 7, 2017.

Written by

Principal Engineer / Architect, FastTrack for Azure at Microsoft

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store