One of the most exciting enhancements that comes with the new Postgresql 10 release,is Logical Replication. The functionality,although not yet as extensive aspgLogicalwhich it is based on,provides a powerful replication option when you want control over table backups at a finite level – allowing all kinds of ETL goodness like:

• replicating only certain tables,columns,or rows
• consolidating multiple databases into a single one
• sharing a subset of the database between multiple databases
• replicating between different major versions of Postgresql

Want to try it without the fuss?

Installing multiple Postgresql 10 sandBoxes on your localhost in 4 easy steps

You want to try it but can’t face installation hell? TheBigSQL distributionhas your back. We make it easy.

1. Make 2 directories:

   # the logical replication publisher mkdir pub_test # the logical replication subscriber mkdir sub_test

2. Navigate to your pub_test directory:

   cd pub_test

3. Install the a postgresql 10 instance (Windows users don’t prefix the pgc command with ./ as shown in the following commands):

   # use this for MAC / Linux: python -c "$(curl -fsSL http://s3.amazonaws.com/pgcentral/install.py)" # use this for Windows: @powershell -NoProfileExecutionPolicy unrestricted Command "iex ((new-object net.webclient).DownloadString('http://s3.amazonaws.com/pgcentral/install.ps1'))"# run pgc commands to install pg10 cd bigsql ./pgc install pg10 pgc start pg10 # make sure the instance is runningpgc status

4. Repeat all of the commands in step 3 after navigating to your sub_test directory:

   cd sub_test

Take note that:

• The first installation,pub_test,will default to port 5432.
• The second installation,sub_test,will default to port 5433.

Edit postgresql.conf

For logical replication to work,you will first need to change the configuration parameterwal_levelto ‘logical’.

So,you will need to edit the file postgresql.conf forBOTHof your Postgresql (pub_test AND sub_test). Navigate to the directory where postgresql.conf is located:

cd {pub_test,sub_test}/bigsql/datapg10

Open the file with your favorite editor and changewal_levelfrom ‘hot_standby’ to ‘logical’

#------------------------------------------------------------------------------# WRITE AHEAD LOG# - Settings - wal_level = logical # (change requires restart)

Navigate to the bigsql directory and restart pg10:

cd ../..pgc restart pg10

Exercise: Rock Legends Database

For this exercise,we will create a rock legends database and setup logical replication on the rocker girls table.

Create the publisher

1. Connect as a superuser to the Postgresql instance that will serve as the publisher:

   #publisher instance in running on port 5432 - the default  psql h localhost p 5432U postgres

2. Create rock_legends_db database:

   postgres=# CREATE DATABASE rock_legends_db; postgres \c rock_legends_db You are now connected to database "rock_legends_db" as user "postgres". 

3. Create table rocker_girls:

   CREATE TABLE rocker_girls ( name @H_14_301@text PRIMARY KEY band @H_14_301@text NOT NULL record_creation_date timestamptz NOT NULL DEFAULT now());

4. Add record to rocker_girls table:

   INSERT INTO rocker_girlsname band) VALUES('Debbie Harry''Blondie');

5. Check to see that rocker_girls table with data was created:

   rock_legends_db select *from rocker_girls  name | band  record_creation_date ------------------------------------------------DebbieHarryBlondie2017-053012:5212.17787304(1 row)

6. Setup the database as the publisher for the rocker_girls table:

   CREATE PUBLICATION pub_rock FOR TABLE rocker_girls;

7. Exit psql:

   =# \q

Create the subscriber

1. Connect as a superuser to the Postgresql instance that will serve as the subscriber:

   #subscriber instance in running on port 5433 - the default 5433U postgres

2. Repeat steps 2 – 3 from above.DO NOTadd any records to the table!

3. Setup the database as the subscriber:

   CREATE SUBSCRIPTION sub_rock CONNECTION 'host=localhost port=5432 dbname=rock_legends_db' PUBLICATION pub_rock;

4. Verify that the rocker_girls “Debbie Harry” row was replicated:

   )

Debbie Harry has been replicated!

Test the replication by adding another record

1. Connect to the publisher:

   psql U postgres d rock_legends_db

2. Add a new record:

   'Janis Joplin''Big Brother and the Holding Company');

3. Disconnect from publisher and connect to subscriber:

    \q psql 5433d rock_legends_db

4. Run select all on rocker_girls table:

    name -----------------------------------JanisJoplinBigBrotherand the HoldingCompany31082257.7083332 rows)

Janis has been replicated!

What’s next

In upcoming posts,I’ll show more ways to manage your replications. In the meantime,you can continue to test in your sandBoxes. And in case you need to blow away your logical replication …

How to delete the subscriber and publisher

 drop subscription testsub NOTICE: dropped replication slot  on publisher DROP SUBSCRIPTION rock_legends_db drop publication alltables DROP PUBLICATION