21h
/
compare-postgres-tables
1
0
Fork 0
Code Issues 0 Pull Requests 0 Releases 4 Wiki Activity
Getting list of tables on servers and counts records
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
16 Commits
1 Branch
1.3 MiB
 
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
 ZIP  TAR.GZ
Vladimir Smagin dff6035456 dockerfile fix 3 weeks ago
build/package add pipeline 4 weeks ago
vendor better logging 3 weeks ago
.gitignore implement argument with config file 3 weeks ago
Dockerfile dockerfile fix 3 weeks ago
Jenkinsfile dockerfile fix 3 weeks ago
README.md check single table 3 weeks ago
config.example.yaml import 4 weeks ago
go.mod better logging 3 weeks ago
go.sum better logging 3 weeks ago
main.go check single table 3 weeks ago

README.md

Compare Postgresql tables

You have servers with master-slave(s) replication and want to be sure what all tables is synced. Program queries count of records for every table in database and shows to you on screen. Used on servers with logical replication and wal-g.

Create config.yaml with connection strings and run compare-pg -config config.yaml. If you want check only single table add argument -table table_name.

Sample config file:

credentials:
  master: postgres://username:password@pg-master.server.ru:5433/mydatabase?sslmode=disable
  slave_logical: postgres://username:password@pg-slave1.server.ru:5432/mydatabase?sslmode=disable
  slave_walg: postgres://username:password@pg-slave2.server.ru:5435/mydatabase?sslmode=disable

Sample output, table user_info is out of sync on slave_logic:

[INFO]  2020/07/16 16:43:53 master successfully connected!
[INFO]  2020/07/16 16:43:54 slave_logic successfully connected!
[INFO]  2020/07/16 16:43:54 Table name: ga
[INFO]  2020/07/16 16:43:55 Postgres name: master 	Count: 25381695 	Size: 5727 MB
[INFO]  2020/07/16 16:43:55 Postgres name: slave_logic 	Count: 25381695 	Size: 6147 MB
[INFO]  2020/07/16 16:43:55 ------------
[INFO]  2020/07/16 16:43:55 Table name: ch_vk_email_phone
[INFO]  2020/07/16 16:43:57 Postgres name: master 	Count: 27670694 	Size: 2770 MB
[INFO]  2020/07/16 16:44:02 Postgres name: slave_logic 	Count: 27670694 	Size: 2770 MB
[INFO]  2020/07/16 16:44:02 ------------
[INFO]  2020/07/16 16:44:04 Table name: user_info
[INFO]  2020/07/16 16:44:16 Postgres name: master 	Count: 414710344 	Size: 135 GB
[INFO]  2020/07/16 16:45:04 Postgres name: slave_logic 	Count: 414555984 	Size: 151 GB
[WARN]  2020/07/16 16:45:04 ------------ TABLES DIFFERENT ------------

Install

Add my Ubuntu\Debian repository http://deb.blindage.org/ and install compare-pg package.

Or download binary from releases tab.

Copyright by Vladimir Smagin (21h) 2020
http://blindage.org email: 21h@blindage.org
Project page: https://git.blindage.org/21h/compare-postgres-tables