This repository was archived by the owner on Oct 22, 2026. It is now read-only.

Repository navigation

[DNM] Fix scan bug when scanning meta data (databases, tables, etc.) - #2086

Closed

birdstorm wants to merge 164 commits into

pingcap:masterfrom

birdstorm:fix-2.4-scan

Closed

[DNM] Fix scan bug when scanning meta data (databases, tables, etc.)#2086
birdstorm wants to merge 164 commits into
pingcap:masterfrom
birdstorm:fix-2.4-scan

Commits on Jun 5, 2020
- release 2.3.0-rc
  marsishandsome
  committed
  ffc301b
- change pom version to 2.3.0-SNAPSHOT
  marsishandsome
  committed
  1221773
Commits on Jun 15, 2020
- update pom version to 2.3.0-SNAPSHOT
  marsishandsome
  committed
  c61498a
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  8c4d9b6
Commits on Jun 22, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  04e2104
- release 2.3.0-rc.1
  marsishandsome
  committed
  9e2765e
- update pom version to 2.3.0-SNAPSHOT
  marsishandsome
  committed
  9da8683
Commits on Jul 6, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  5c86cdb
- add release notes for 2.3.0
  marsishandsome
  committed
  4fb3783
- change pom version to 2.3.0
  marsishandsome
  committed
  106c28f
- change pom version to 2.3.1-SNAPSHOT
  marsishandsome
  committed
  9686dd3
Commits on Jul 8, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  8563b48
- release 2.3.1
  marsishandsome
  committed
  f7fdbc8
- update pom version to 2.3.2-SNAPSHOT
  marsishandsome
  committed
  b4ab9dd
Commits on Jul 16, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  60eea6a
Commits on Aug 12, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  5223f79
Commits on Aug 19, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  719d02e
Commits on Aug 21, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  86b9f19
- udpate pom version to 2.3.2
  marsishandsome
  committed
  cd43c5c
- Revert "udpate pom version to 2.3.3-SNAPSHOT"
  marsishandsome
  committed
  8e20f42
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  fdfb531
Commits on Aug 31, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  acf825f
Commits on Sep 2, 2020
Commits on Sep 15, 2020
Commits on Sep 24, 2020
- Merge remote-tracking branch 'origin/master' into release-2.3
  marsishandsome
  committed
  93d3980
- update README
  marsishandsome
  committed
  1975d8b
- delete df.explain (#1630)
  
  ti-srebot
  and
  marsishandsome
  authored
  bf4cc8b
Commits on Sep 25, 2020
- use set to store resolvedLocks (#1635)
  
  ti-srebot
  and
  marsishandsome
  authored
  3b77472
- fix batch write failed because of MetaCodec.hashGet (#1636)
  
  ti-srebot
  and
  marsishandsome
  authored
  a7cd7b4
- ignore test: read conflict using jdbc: primary key (#1637)
  
  ti-srebot
  and
  marsishandsome
  authored
  bef2ea0
- update verion to 2.3.6-SNAPSHOT
  marsishandsome
  committed
  aada118
- release tispark-2.3.5 (#1638)
  marsishandsome
  committed
  7f5d01c
Commits on Oct 10, 2020
- fix alter primary key (#1640)
  
  ti-srebot
  and
  birdstorm
  authored
  6200122
Commits on Oct 14, 2020
- Fix alter primary key for write (#1644) (#1645)
  marsishandsome
  authored
  9687b70
Commits on Oct 16, 2020
- update version to 2.3.7-SNAPSHOT
  marsishandsome
  committed
  7e1168d
- release tispark-2.3.6 (#1647)
  
  ti-srebot
  and
  marsishandsome
  authored
  430d237
- update pom to 2.4.0-SNAPSHOT
  marsishandsome
  committed
  ea8e067
- support invisible index (#1649) (#1652)
  ti-srebot
  authored
  6ac0a98
Commits on Oct 20, 2020
- upgrade spark to 2.4.6 (#1648) (#1654)
  ti-srebot
  authored
  4da13d0
Commits on Oct 26, 2020
- enable user provided auto increment value in update mode (#1659)
  
  ti-srebot
  and
  marsishandsome
  authored
  436fab3
- BatchWrite: fix initial ttl expired (#1662)
  
  ti-srebot
  and
  marsishandsome
  authored
  e0e6cea
- add parameter document: bytesPerRegion (#1666)
  
  ti-srebot
  and
  marsishandsome
  authored
  4529f44
Commits on Oct 27, 2020
- BatchWrite: fix commit_ts_expired (#1668)
  
  ti-srebot
  and
  marsishandsome
  authored
  cef1393
- release-2.3.7 (#1672)
  
  ti-srebot
  and
  marsishandsome
  authored
  6ce022d
- fix negative column id when there are more than 128 columns (#1674)
  
  ti-srebot
  and
  Dieken
  authored
  fd9b72e
- fix wrong conversion from LocalDate to days since UNIX epoch (#1676)
  ti-srebot
  authored
  e1d609b
- Revert "fix wrong conversion from LocalDate to days since UNIX epoch (#1676)" (#1680)
  marsishandsome
  authored
  ca57064
- fix TiSession Close bug (#1682)
  
  ti-srebot
  and
  marsishandsome
  authored
  66eabd9
Commits on Oct 28, 2020
- optimize region split number in small data size (#1690)
  
  ti-srebot
  and
  marsishandsome
  authored
  28f5781
Commits on Oct 29, 2020
- BatchWrite: fix auto increment column not primary key (#1696)
  
  ti-srebot
  and
  marsishandsome
  authored
  748a7c8
- BatchWrite: add more log for exception (#1698)
  
  ti-srebot
  and
  marsishandsome
  authored
  845428e
Commits on Oct 30, 2020
- fix incorrect date type value when timezone is set (#1705)
  
  ti-srebot
  and
  birdstorm
  authored
  c18da63
- release tispark-2.3.8 (#1708)
  
  ti-srebot
  and
  marsishandsome
  authored
  1b79cf7
- fix typo in datetime calculation (#1711)
  
  ti-srebot
  and
  birdstorm
  authored
  775e596
- Revert "fix TiSession Close bug (#1682)" (#1714)
  marsishandsome
  authored
  f1fa74d
Commits on Oct 31, 2020
- fix LockTimeoutSuite (#1716)
  
  ti-srebot
  and
  marsishandsome
  authored
  7db1dee
- release tispark-2.3.9 (#1720)
  
  ti-srebot
  and
  marsishandsome
  authored
  965ffee
Commits on Nov 3, 2020
- Fix string insert overflow check (#1723) (#1728)
  ti-srebot
  authored
  92a08c4
- BatchWrite: add parameter maxRegionSplitNum (#1731)
  
  ti-srebot
  and
  marsishandsome
  authored
  b01747f
Commits on Nov 4, 2020
- fix maven-shade-plugin relocation cannot handle folder name with dot (#1739)
  
  ti-srebot
  and
  marsishandsome
  authored
  06b1ed4
Commits on Nov 6, 2020
- release tispark-2.3.10 (#1750)
  
  ti-srebot
  and
  marsishandsome
  authored
  cb2ba12
Commits on Nov 16, 2020
- make test stable (#1755) (#1756)
  marsishandsome
  authored
  d47f80c
Commits on Nov 18, 2020
- Fix enum insert with trailing spaces (#1751) (#1759)
  ti-srebot
  authored
  824294f
Commits on Nov 23, 2020
- fix column name compare bug (#1772)
  
  ti-srebot
  and
  marsishandsome
  authored
  aeced9f
- add document for writing to json type (#1776)
  
  ti-srebot
  and
  marsishandsome
  authored
  08c658f
- add test for integer conversion (#1779)
  
  ti-srebot
  and
  marsishandsome
  authored
  4af3a54
- add conversion from java.math.BigDecimal to Long (#1782)
  
  ti-srebot
  and
  marsishandsome
  authored
  46c2ef3
Commits on Nov 24, 2020
- fix Table default.st1 already exists (#1785)
  
  ti-srebot
  and
  marsishandsome
  authored
  e4bfe54
- BatchWrite: support insert null on auto increment column (#1787)
  
  ti-srebot
  and
  marsishandsome
  authored
  5fd74b0
Commits on Nov 25, 2020
- disable year type index scan (#1792)
  
  ti-srebot
  and
  marsishandsome
  authored
  14ac364
- do not retry for some key error (#1800)
  
  ti-srebot
  and
  windtalker
  authored
  6b6ff32
Commits on Nov 26, 2020
- update idleMinutes to 10 (#1804)
  
  ti-srebot
  and
  marsishandsome
  authored
  e15a52d
- support log desensitization (#1806)
  
  ti-srebot
  and
  marsishandsome
  authored
  c834e7e
- fix test with tidb master branch, Too many keys specified; max 64 keys allowed (#1760)
  marsishandsome
  committed
  98355da
- continue fix test with tidb master branch, Too many keys specified; max 64 keys allowed (#1761)
  marsishandsome
  committed
  ab91e92
- fix UnitTest with tidb master branch (#1762)
  marsishandsome
  committed
  12f6d82
- ignore test: NPE when decoding datetime,date,timestamp (#1795)
  marsishandsome
  committed
  01f3768
- support Async Commit: update resolve lock logic (#1746) (#1801)
  
  ti-srebot
  and
  marsishandsome
  authored
  673c93a
Commits on Nov 27, 2020
- make ci test stable (#1809)
  
  ti-srebot
  and
  marsishandsome
  authored
  5121cd5
Commits on Nov 30, 2020
- make regression test stable (#1814)
  
  ti-srebot
  and
  marsishandsome
  authored
  41f6ecb
- support read and write table with expression index (#1815)
  
  ti-srebot
  and
  marsishandsome
  authored
  f2ce109
Commits on Dec 1, 2020
- ignore lineitem batchwrite test (#1818)
  
  ti-srebot
  and
  marsishandsome
  authored
  9f3081d
Commits on Dec 2, 2020
- add document netty oom (#1821)
  
  ti-srebot
  and
  marsishandsome
  authored
  d2cc0c3
- fix document typo (#1825)
  
  ti-srebot
  and
  marsishandsome
  authored
  e92bd48
- add document spark.sql.runSQLOnFiles (#1828)
  
  ti-srebot
  and
  marsishandsome
  authored
  b9745ae
- add document show create table (#1832)
  
  ti-srebot
  and
  marsishandsome
  authored
  9437cc1
- Using the style of {db}.{table}.{colname} in the condition is not supported (#1836)
  
  ti-srebot
  and
  marsishandsome
  authored
  f8e4037
Commits on Dec 3, 2020
- support auto_random column (#1837) (#1839)
  
  ti-srebot
  and
  marsishandsome
  authored
  c46ce55
- fix select count where values contains null (#1840) (#1842)
  
  ti-srebot
  and
  marsishandsome
  authored
  e6a9034
Commits on Dec 4, 2020
- add test: select count(a, b) with null values (#1845)
  
  ti-srebot
  and
  marsishandsome
  authored
  7b84178
- ignore test lock on tiflash: not expired (#1848)
  
  ti-srebot
  and
  marsishandsome
  authored
  2220f40
- fix Too many keys specified; max 64 keys allowed (#1849) (#1850)
  ti-srebot
  authored
  3fa0ff0
- null in aggregration it not supported, e.g. select sum(null) from t group by col1 (#1854)
  
  ti-srebot
  and
  marsishandsome
  authored
  b5fec35
- ignore text type overflow test (#1858)
  
  ti-srebot
  and
  marsishandsome
  authored
  52dbdc3
Commits on Dec 14, 2020
- add retry in RowIDAllocator (#1856) (#1861)
  
  ti-srebot
  and
  marsishandsome
  authored
  1d0bc2c
Commits on Dec 15, 2020
- fix tispark overflow test (#1865)
  
  ti-srebot
  and
  marsishandsome
  authored
  41884b8
Commits on Dec 16, 2020
- fix overflow when convert big MyDecimal to BigDecimal (#1870)
  
  ti-srebot
  and
  Dieken
  authored
  aed983e
- txn: fix the resolved txn status cache for pessimistic txn #1868 (#1872)
  
  ti-srebot
  and
  marsishandsome
  authored
  b6d0718
Commits on Dec 17, 2020
- release tispark-2.3.11 (#1876)
  
  ti-srebot
  and
  marsishandsome
  authored
  cf7b8c7
Commits on Dec 23, 2020
- add doc for garbled chinese characters problem (#1880)
  
  ti-srebot
  and
  marsishandsome
  authored
  32495f8
Commits on Jan 11, 2021
- add retry in RangeSplitter (#1887)
  
  ti-srebot
  and
  marsishandsome
  authored
  966b65b
Commits on Jan 28, 2021
- fix TiDAGRequest concurrent visit (#1896)
  
  ti-srebot
  and
  marsishandsome
  authored
  37542c4
Commits on Jan 29, 2021
- fix partition table with partition column name date (#1892) (#1899)
  ti-srebot
  authored
  714aee5
Commits on Feb 1, 2021
- release-2.3.12 (#1903)
  
  ti-srebot
  and
  marsishandsome
  authored
  8b4f424
Commits on Feb 4, 2021
- fix BatchGet retry (#1908)
  
  ti-srebot
  and
  marsishandsome
  authored
  b40f069
Commits on Feb 5, 2021
- fix jackson-databind (#1912)
  
  ti-srebot
  and
  marsishandsome
  authored
  2405b6c
Commits on Mar 3, 2021
- disable index scan on partition table (#1925)
  
  ti-srebot
  and
  birdstorm
  authored
  6eaf883
Commits on Mar 5, 2021
- release tispark 2.3.13 (#1931)
  
  ti-srebot
  and
  marsishandsome
  authored
  719bfc8
Commits on Mar 10, 2021
- ignore json test (#1936)
  
  ti-srebot
  and
  marsishandsome
  authored
  d1de2ae
- support clustered index (#1915) (#1918)
  ti-srebot
  authored
  5d4c56c
- disable index scan for clustered index table (#1919)
  marsishandsome
  committed
  864fe34
- clustered index support IndexScan (#1926)
  marsishandsome
  committed
  e95631b
- fix cluster index bug: primary key has more than one column (#1934)
  marsishandsome
  committed
  bfe34ab
Commits on Mar 12, 2021
- disable date test in ClusteredIndexTest (#1941)
  
  guliangliangatpingcap
  and
  marsishandsome
  authored
  da92a61
- ignore large column test (#1943)
  
  guliangliangatpingcap
  and
  marsishandsome
  authored
  306b4b7
- ignore clustered index test if tidb does not support (#1945)
  
  ti-srebot
  and
  marsishandsome
  authored
  02b4760
- fix WriteWriteConflictSuite (#1946)
  
  guliangliangatpingcap
  and
  marsishandsome
  authored
  a2c8a22
Commits on Mar 15, 2021
- fix test with tidb does not support clustered index (#1950)
  
  ti-srebot
  and
  marsishandsome
  authored
  38b5eab
- fix Test Convert from java.lang.Long to REAL (#1954)
  
  ti-srebot
  and
  marsishandsome
  authored
  28e795e
- fix unit test: NPE when decoding datetime,date,timestamp (#1958)
  marsishandsome
  authored
  712f39d
Commits on Mar 16, 2021
- fix GregorianCalendar (#1952) (#1960)
  marsishandsome
  authored
  343d1cd
- continue to fix GregorianCalendar (#1961)
  marsishandsome
  authored
  4988b24
- format code
  marsishandsome
  committed
  9d88d1d
- Revert "disable date test in ClusteredIndexTest (#1941)" (#1963)
  marsishandsome
  authored
  7af6522
Commits on Mar 17, 2021
- fix tiflash timestamp pushdown bug (#1967)
  
  ti-srebot
  and
  marsishandsome
  authored
  db4bbb3
- let test success because of a tiflash bug (#1969)
  marsishandsome
  authored
  7bf5879
Commits on Mar 19, 2021
- fix tidb_enable_clustered_index only support global variable (#1972) (#1973)
  marsishandsome
  authored
  a10b2c8
Commits on Mar 22, 2021
- fix tidb_enable_clustered_index test with tidb-4.0 (#1975)
  
  ti-srebot
  and
  marsishandsome
  authored
  03facba
Commits on Mar 24, 2021
- update userguide.md: add partition syntax guide. (#1976) (#1980)
  
  ti-srebot
  and
  LittleFall
  authored
  9aaf759
Commits on Mar 25, 2021
- fix regresstion test: AutoIncrementSuite (#1978) (#1982)
  
  ti-srebot
  and
  marsishandsome
  authored
  0b8de4c
Commits on Mar 29, 2021
- print schema in test (#1984)
  
  ti-srebot
  and
  marsishandsome
  authored
  87e3687
Commits on Mar 30, 2021
- fix large column number + double read bug (#1985)
  marsishandsome
  authored
  786b9bd
Commits on Mar 31, 2021
- add nightly download link (#1990)
  
  ti-srebot
  and
  marsishandsome
  authored
  cd0f6ff
Commits on Apr 2, 2021
- do not select tidb_row_format_version if tidb is 3.x (#1994)
  
  ti-srebot
  and
  marsishandsome
  authored
  d3742a8
- use comment to create clustered index table in test (#1998)
  
  ti-srebot
  and
  marsishandsome
  authored
  654c4e7
Commits on Apr 6, 2021
- fix bigint max handle (#2003)
  
  ti-srebot
  and
  birdstorm
  authored
  15dbe7a
Commits on Apr 7, 2021
- fix clustered index read + GregorianCalendar (#2006)
  marsishandsome
  authored
  1e64918
Commits on Apr 8, 2021
- update table statistics after batch write (#2004) (#2008)
  
  ti-srebot
  and
  marsishandsome
  authored
  f4b0035
Commits on Apr 9, 2021
- fix oom cause missing data bug (#2013)
  
  ti-srebot
  and
  marsishandsome
  authored
  7d5af66
Commits on Apr 12, 2021
- add argument: enableUpdateTableStatistics (#2011) (#2015)
  
  ti-srebot
  and
  marsishandsome
  authored
  a75329f
- release tispark 2.3.14 (#2019)
  
  ti-srebot
  and
  marsishandsome
  authored
  f9163c1
Commits on Apr 15, 2021
- release tispark 2.4.0 (#2023)
  
  ti-srebot
  and
  marsishandsome
  authored
  c8f7fee
Commits on Apr 16, 2021
- add document: GRPC message exceeds maximum size error (#2027)
  
  ti-srebot
  and
  marsishandsome
  authored
  00b3dc7
Commits on Apr 19, 2021
- change PARTITION_PER_SPLIT default value from 1 to 10 (#2030)
  
  ti-srebot
  and
  marsishandsome
  authored
  95e95ea
Commits on Apr 20, 2021
- ignore stats_meta update modify_count test (#2033)
  
  ti-srebot
  and
  marsishandsome
  authored
  b5ce4d9
Commits on Apr 21, 2021
- update log level to debug (#2037)
  
  ti-srebot
  and
  marsishandsome
  authored
  d17013e
- revert https://github.com/pingcap/tispark/pull/1969/ (#2040)
  
  ti-srebot
  and
  marsishandsome
  authored
  aca0820
- fix array index out of bound when decoding (#2042)
  
  ti-srebot
  and
  birdstorm
  authored
  d0a6d21
- shade gson (#2043)
  
  ti-srebot
  and
  marsishandsome
  authored
  a2c8929
Commits on Apr 26, 2021
- fix batch write missing unpersist (#2047)
  
  ti-srebot
  and
  marsishandsome
  authored
  ee18cf9
Commits on Apr 28, 2021
- refactor database random test (#2045) (#2051)
  marsishandsome
  authored
  b02e9bc
- update pom version to 2.4.1-SNAPSHOT
  marsishandsome
  committed
  1092332
Commits on Apr 29, 2021
- fix bug: write decimal(16, 4) using batch write and read using tiflash (#2055)
  
  ti-srebot
  and
  marsishandsome
  authored
  1f9d951
- fix random test with tiflash enabled (#2058)
  
  ti-srebot
  and
  marsishandsome
  authored
  d4b2c00
Commits on Apr 30, 2021
- ignore test: Test sql with limit without order by (#2063)
  
  ti-srebot
  and
  marsishandsome
  authored
  edc8475
- ignore enum type test because of https://github.com/pingcap/tidb/issues/24395 (#2065)
  
  ti-srebot
  and
  marsishandsome
  authored
  e992fb0
- Fix mistake setting current_ts to 0 (#2067)
  
  ti-srebot
  and
  marsishandsome
  authored
  c357c63
Commits on May 11, 2021
- hotfix (#2071)
  
  ti-srebot
  and
  marsishandsome
  authored
  23592a2
Commits on May 12, 2021
- add arguemnt: deduplicate (#2073)
  
  ti-srebot
  and
  marsishandsome
  authored
  5ba48bc
Commits on Jul 23, 2021
- fix v2.4 scan bug
  birdstorm
  committed
  64aac14

Commits

Commits on Jun 5, 2020

Commits on Jun 15, 2020

Commits on Jun 22, 2020

Commits on Jul 6, 2020

Commits on Jul 8, 2020

Commits on Jul 16, 2020

Commits on Aug 12, 2020

Commits on Aug 19, 2020

Commits on Aug 21, 2020

Commits on Aug 31, 2020

Commits on Sep 2, 2020

Commits on Sep 15, 2020

Commits on Sep 24, 2020

Commits on Sep 25, 2020

Commits on Oct 10, 2020

Commits on Oct 14, 2020

Commits on Oct 16, 2020

Commits on Oct 20, 2020

Commits on Oct 26, 2020

Commits on Oct 27, 2020

Commits on Oct 28, 2020

Commits on Oct 29, 2020

Commits on Oct 30, 2020

Commits on Oct 31, 2020

Commits on Nov 3, 2020

Commits on Nov 4, 2020

Commits on Nov 6, 2020

Commits on Nov 16, 2020

Commits on Nov 18, 2020

Commits on Nov 23, 2020

Commits on Nov 24, 2020

Commits on Nov 25, 2020

Commits on Nov 26, 2020

Commits on Nov 27, 2020

Commits on Nov 30, 2020

Commits on Dec 1, 2020

Commits on Dec 2, 2020

Commits on Dec 3, 2020

Commits on Dec 4, 2020

Commits on Dec 14, 2020

Commits on Dec 15, 2020

Commits on Dec 16, 2020

Commits on Dec 17, 2020