Skip to content

TiSpark 2.0
Compare
Choose a tag to compare
@birdstorm birdstorm released this 11 Mar 05:50
· 787 commits to master since this release
2.0
939fca6

TiSpark 2.0 is released!

TiSpark works with Spark 2.3 now and uses multiple new features such as Spark Extensions. The new document can be found at https://github.com/pingcap/tispark/blob/master/docs/userguide.md#demo .

Features

  • Work with Spark 2.3
  • Support use $database statement
  • Support show databases statement
  • Support show tables statement
  • No need to use TiContext.mapTiDBDatabase, use $database.$table to identify a table instead
  • Support data type SET and ENUM
  • Support data type YEAR
  • Support data type TIME
  • Support isolation level settings
  • Support describe table command
  • Support cache tables and uncache tables
  • Support read from a TiDB partition table
  • Support use TiDB as metastore

Fixes

  • Fix JSON parsing (#491)
  • Fix count on empty table (#498)
  • Fix ScanIterator unable to read from adjacent empty regions (#519)
  • Fix possible NullPointerException when setting show_row_id true (#522)

Improved

  • Make ti version usable without selecting database (#545)
Assets 3
Loading