文章目錄
- 一. Trino CLI
- 1. 安裝client
- 2. 使用client執行sql
- 二. JDBC driver 連接Trino
- 1. 通過DBeaver用戶界面連接
- 2. JDBC Driver in java
- 2.1. 環境配置
- 2.2. 注冊和配置driver
- 2.3. 連接參數
- 2.4. 查詢例子
一. Trino CLI
1. 安裝client
Trino CLI提供了一個基于終端的交互式shell。你可以通過它運行查詢并與Trino服務端交互來檢查其元數據。
下載地址:trino-cli-434-executable.jar
# 下載wget -O trino https://repo1.maven.org/maven2/io/trino/trino-cli/434/trino-cli-434-executable.jar# 添加可執行權限、并將其添加到PATH下,方便使用
chmod +x trino
mv trino ~/bin
export PATH=~/bin/:$PATH
?
2. 使用client執行sql
./trino http://trino.example.com:8080# 幫助文檔
trino> helpSupported commands:
QUIT
EXIT
CLEAR
EXPLAIN [ ( option [, ...] ) ] <query>options: FORMAT { TEXT | GRAPHVIZ | JSON }TYPE { LOGICAL | DISTRIBUTED | VALIDATE | IO }
DESCRIBE <table>
SHOW COLUMNS FROM <table>
SHOW FUNCTIONS
SHOW CATALOGS [LIKE <pattern>]
SHOW SCHEMAS [FROM <catalog>] [LIKE <pattern>]
SHOW TABLES [FROM <schema>] [LIKE <pattern>]
USE [<catalog>.]<schema>
?
運行sql
trino> select * from "mysql-1".flinkx_test.flinkx_hdfs_log-> ;id | ip | stamp | url | refer | useragent | pid | uid | mid | insert_time | create_time | create_date
------+-----------------+-------+------+-------+-----------+----------+------+------+---------------------+-------------+-------------1 | NULL | NULL | NULL | aaaa | NULL | 20221212 | NULL | NULL | 2023-01-31 16:32:09 | NULL | 2023-01-111 | NULL | NULL | NULL | aaaa | NULL | 20221212 | NULL | NULL | 2023-01-31 18:37:20 | NULL | 2023-01-11 ...
(18 rows)Query 20231206_032803_00000_78prf, FINISHED, 1 node
Splits: 1 total, 1 done (100.00%)
0.67 [18 rows, 0B] [26 rows/s, 0B/s]
?
連接trino時可以設置默認的catalog(某個連接實例)和schema(數據庫),這樣可以直接查詢表。
./trino http://localhost:8080/mysql-1/flinkx_test
trino:flinkx_test> show tables;Table
-----------------------------------------------------aaaaaa_csv111_1aaa_csv111_2
...
?
USE默認的catalog和schema,直接查詢此庫下的表
trino> USE tpch.tiny;
USE
trino:tiny>
?
debug功能
./trino http://localhost:8080/mysql-1/flinkx_test --debug trino:flinkx_test> select * from "mysql-1".flinkx_test.flinkx_hdfs_log-> ;id | ip | stamp | url | refer | useragent | pid | uid | mid | insert_time | create_time | create_date
------+-----------------+-------+------+-------+-----------+----------+------+------+---------------------+-------------+-------------1 | NULL | NULL | NULL | aaaa | NULL | 20221212 | NULL | NULL | 2023-01-31 16:32:09 | NULL | 2023-01-111 | NULL | NULL | NULL | aaaa | NULL | 20221212 | NULL | NULL | 2023-01-31 18:37:20 | NULL | 2023-01-11
...http://localhost:8080/ui/query.html?20231206_033726_00007_78prf
Splits: 1 total, 1 done (100.00%)
CPU Time: 0.0s total, 3K rows/s, 0B/s, 4% active
Per Node: 0.0 parallelism, 30 rows/s, 0B/s
Parallelism: 0.0
Peak Memory: 64B
0.60 [18 rows, 0B] [30 rows/s, 0B/s]
?
--execute選項
./trino http://localhost:8080/mysql-1/flinkx_test --execute 'select * from "mysql-1".flinkx_test.flinkx_hdfs_log limit 3;'"1","","","","aaaa","","20221212","","","2023-01-31 16:32:09","","2023-01-11"
"1","","","","aaaa","","20221212","","","2023-01-31 18:37:20","","2023-01-11"
"","124.239.193.194","","","","","h_home","","","2023-02-10 10:52:01","",""
?
避免使用完全限定符
# 使用`--catalog`和`--schema`選項來
./trino http://localhost:8080 --catalog "mysql-1" --schema flinkx_test \--execute 'select * from flinkx_hdfs_log limit 3;'# 通過http設限定符
./trino http://localhost:8080/mysql-1/flinkx_test \--execute 'select * from flinkx_hdfs_log limit 3;'
?
執行多個sql
trino http://localhost:8080 \--execute 'use "mysql-1".flinkx_test;select * from flinkx_hdfs_log limit 3;'
?
執行sql文件
vim trino.sql
use "mysql-1".flinkx_test;
select * from flinkx_hdfs_log limit 3;./trino http://localhost:8080 -f trino.sql
?
輸出格式
Trino CLI提供了
--output-format
選項來控制如何在非交互模式下顯示輸出,可用的選項有ALIGNED、VERTICAL、TSV、TSV_HEADER、CSV、CSV_HEADER、CSV_UNQUOTED、CSV_HEADER_UNQUOTED、JSON和NULL,默認值是CSV。
?
忽略錯誤
Trino CLI提供了
--ignore-error
選項來忽略執行文件中的查詢時遇到的任何錯誤。默認行為是在遇到第一個錯誤時終止執行腳本。
?
二. JDBC driver 連接Trino
任何Java應用程序都可以通過Java數據庫連接(JDBC)驅動連接到Trino。通過JDBC驅動,所有這些應用程序都可以使用Trino。
Trino的JDBC驅動允許你連接到Trino并使用SQL語句與Trino交互。
如果你熟悉JDBC驅動的不同實現,就知道Trino的JDBC驅動是Type 4驅動,這僅僅意味著它直接與Trino原生協議通信。
?
1. 通過DBeaver用戶界面連接
查看表時出現如下錯誤:
需要聲明用戶,默認輸入admin、密碼為空
重新連接可以看到注冊的catalog了
可以像之前使用DBeaver查看表了。
?
2. JDBC Driver in java
2.1. 環境配置
需要java 8 或更高
所有通過JDBC連接Trino的用戶,必須在system.jdbc
schema中賦予權限
maven依賴:
<dependency><groupId>io.trino</groupId><artifactId>trino-jdbc</artifactId><version>434</version>
</dependency>
其他版本地址在:
A list of all available versions can be found in the Maven Central Repository.
客戶端使用http協議和 Trino client REST API 和Trino進行通訊。
?
2.2. 注冊和配置driver
JDBC URL支持的格式:
jdbc:trino://host:port
jdbc:trino://host:port/catalog
jdbc:trino://host:port/catalog/schema
舉例:
jdbc:trino://example.net:8080/hive/sales
連接example.net上的trino(8080端口),并明確了catalog和schema。
如果trino的驅動識別不到,則可以顯式聲明:
io.trino.jdbc.TrinoDriver
。
?
2.3. 連接參數
聲明方式有如下兩種
// properties
String url = "jdbc:trino://example.net:8080/hive/sales";
Properties properties = new Properties();
properties.setProperty("user", "test");
properties.setProperty("password", "secret");
properties.setProperty("SSL", "true");
Connection connection = DriverManager.getConnection(url, properties);// URL parameters
String url = "jdbc:trino://example.net:8443/hive/sales?user=test&password=secret&SSL=true";
Connection connection = DriverManager.getConnection(url);
當然這兩種方式我們可以混用,有些參數通過properties設置,有些在url中設置。
完整的參數見:Parameter reference
?
2.4. 查詢例子
package com.gao;import java.sql.*;public class TrinoQueryExample {public static void main(String[] args) {// Trino數據庫連接信息String trinoUrl = "jdbc:trino://xxx:8080";String trinoUser = "admin";String trinoPassword = "";// SQL查詢語句String sqlQuery = "select * from \"mysql-1\".flinkx_test.flinkx_hdfs_log limit 3";try {Class.forName("io.trino.jdbc.TrinoDriver");// 建立Trino數據庫連接Connection connection = DriverManager.getConnection(trinoUrl, trinoUser, trinoPassword);// 創建Statement對象Statement statement = connection.createStatement();// 執行查詢ResultSet resultSet = statement.executeQuery(sqlQuery);// 處理查詢結果while (resultSet.next()) {// 根據查詢結果的列名或索引獲取數據Integer id = resultSet.getInt("id");Timestamp create_time = resultSet.getTimestamp("create_time");// 處理獲取的數據System.out.println("id: " + id + ", create_time: " + create_time);}// 關閉資源resultSet.close();statement.close();connection.close();} catch (SQLException e) {e.printStackTrace();} catch (ClassNotFoundException e) {throw new RuntimeException(e);}}
}id: 1, create_time: null
id: 1, create_time: null
id: 0, create_time: null
?
?
參考:
《trino權威指南:原書第二版》
trino官網:https://trino.io/docs/current/client.html