Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

database source is already in use #871

Open
dataNdeadlifts opened this issue Aug 23, 2024 · 1 comment
Open

database source is already in use #871

dataNdeadlifts opened this issue Aug 23, 2024 · 1 comment

Comments

@dataNdeadlifts
Copy link

dataNdeadlifts commented Aug 23, 2024

Incredibly useful tool, I really appreciate all the work that went into building it.

I am running into some issues using the clone --follow command however that I suspect may be a bug. I am running version 0.17 compiled from source as a container. I have the command and debug output below. A non-cdc clone works as expected.

Likely the same as issue 829.

pgcopydb clone --debug --no-owner --no-acl --skip-extensions --dir /work --filter /work/filter.ini --drop-if-exists --follow

2024-08-23 00:05:23.721 1 INFO   main.c:136                Running pgcopydb version 0.17 from "/usr/local/bin/pgcopydb"
2024-08-23 00:05:23.722 1 DEBUG  copydb.c:359              Change Data Capture data is managed at "/work/cdc"
2024-08-23 00:05:23.722 1 NOTICE cli_common.c:437          Re-using --snapshot '00000007-000004E8-1' found at "/work/snapshot"
2024-08-23 00:05:23.722 1 NOTICE snapshot.c:590            Read replication slot file "/work/cdc/slot" with snapshot "00000007-000004E8-1", slot "pgcopydb", lsn 1F/3106DBB8, and plugin "test_decoding"
2024-08-23 00:05:23.722 1 INFO   cli_common.c:1225         [SOURCE] Copying database from "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.722 1 INFO   cli_common.c:1226         [TARGET] Copying database into "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.745 1 DEBUG  cli_common.c:1230         Using pg_dump for Postgres "16.4" at "/usr/bin/pg_dump"
2024-08-23 00:05:23.745 1 DEBUG  cli_common.c:1234         Using pg_restore for Postgres "16.4" at "/usr/bin/pg_restore"
2024-08-23 00:05:23.745 1 DEBUG  copydb.c:359              Change Data Capture data is managed at "/work/cdc"
2024-08-23 00:05:23.745 1 INFO   copydb.c:105              Using work dir "/work"
2024-08-23 00:05:23.745 1 DEBUG  queue_utils.c:45          Created message vacuum queue 0 (cleanup with `ipcrm -q 0`)
2024-08-23 00:05:23.745 1 DEBUG  queue_utils.c:45          Created message create index queue 1 (cleanup with `ipcrm -q 1`)
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:186           Sections "include-only-schema" not found
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:198           Section "exclude-schema" has 3 entries
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:261           excluding schema "pghero"
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:261           excluding schema "pglogical"
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:261           excluding schema "repack"
2024-08-23 00:05:23.745 1 DEBUG  filtering.c:186           Sections "exclude-table" not found
2024-08-23 00:05:23.746 1 DEBUG  filtering.c:186           Sections "exclude-table-data" not found
2024-08-23 00:05:23.746 1 DEBUG  filtering.c:186           Sections "exclude-index" not found
2024-08-23 00:05:23.746 1 DEBUG  filtering.c:186           Sections "include-only-table" not found
2024-08-23 00:05:23.746 1 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/source.db" with lib version 3.45.1
2024-08-23 00:05:23.746 1 DEBUG  lock_utils.c:139          Created semaphore 1 (cleanup with ipcrm -s)
2024-08-23 00:05:23.746 1 DEBUG  queue_utils.c:45          Created message transform queue 2 (cleanup with `ipcrm -q 2`)
2024-08-23 00:05:23.746 1 INFO   snapshot.c:395            Re-using replication slot "pgcopydb" created at 1F/3106DBB8 with snapshot "00000007-000004E8-1"
2024-08-23 00:05:23.748 1 SQL    pgsql.c:501               Connecting to [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.755 1 SQL    pgsql.c:1568              [TARGET 502] BEGIN;
2024-08-23 00:05:23.755 1 SQL    pgsql.c:1568              [TARGET 502] select pg_replication_origin_oid($1);
2024-08-23 00:05:23.755 1 SQL    pgsql.c:1581              [TARGET 502] 'pgcopydb'
2024-08-23 00:05:23.756 1 SQL    pgsql.c:1568              [TARGET 502] select pg_replication_origin_progress($1, $2);
2024-08-23 00:05:23.756 1 SQL    pgsql.c:1581              [TARGET 502] 'pgcopydb', 't'
2024-08-23 00:05:23.758 1 INFO   ld_stream.c:2512          Replication origin "pgcopydb" already exists at LSN 1F/3106DBB8
2024-08-23 00:05:23.758 1 SQL    pgsql.c:1568              [TARGET 502] COMMIT;
2024-08-23 00:05:23.759 1 SQL    pgsql.c:410               Disconnecting from [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.759 1 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/source.db": already opened
2024-08-23 00:05:23.759 1 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/filter.db" with lib version 3.45.1
2024-08-23 00:05:23.759 1 DEBUG  lock_utils.c:139          Created semaphore 2 (cleanup with ipcrm -s)
2024-08-23 00:05:23.759 1 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/target.db" with lib version 3.45.1
2024-08-23 00:05:23.759 1 DEBUG  lock_utils.c:139          Created semaphore 3 (cleanup with ipcrm -s)
2024-08-23 00:05:23.759 1 DEBUG  catalog.c:634             Catalog has been setup for source "postgres://postgres@localhost:5432/gauntlet", target "postgres://migration@tklier-z4:8543/db", snapshot "00000007-000004E8-1"
2024-08-23 00:05:23.762 1 DEBUG  copydb_schema.c:100       --not-consistent, create a fresh connection
2024-08-23 00:05:23.762 1 SQL    pgsql.c:501               Connecting to [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.770 1 SQL    pgsql.c:1568              [SOURCE 4181753] BEGIN;
2024-08-23 00:05:23.770 1 SQL    pgsql.c:1568              [SOURCE 4181753] select has_database_privilege(current_database(), $1);;
2024-08-23 00:05:23.770 1 SQL    pgsql.c:1581              [SOURCE 4181753] 'create'
2024-08-23 00:05:23.771 1 SQL    pgsql.c:1568              [SOURCE 4181753] select has_database_privilege(current_database(), $1);;
2024-08-23 00:05:23.771 1 SQL    pgsql.c:1581              [SOURCE 4181753] 'temp'
2024-08-23 00:05:23.771 1 SQL    pgsql.c:1568              [SOURCE 4181753] select current_setting('search_path');
2024-08-23 00:05:23.772 1 SQL    pgsql.c:1568              [SOURCE 4181753] set local search_path to pgcopydb, "$user", public;
2024-08-23 00:05:23.772 1 SQL    pgsql.c:1568              [SOURCE 4181753] COMMIT;
2024-08-23 00:05:23.772 1 SQL    pgsql.c:410               Disconnecting from [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.790 1 SQL    pgsql.c:501               Connecting to [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.796 1 SQL    pgsql.c:1568              [TARGET 503] BEGIN;
2024-08-23 00:05:23.797 1 SQL    pgsql.c:1568              [TARGET 503] select n.oid, n.nspname,        format('- %s %s',                 regexp_replace(n.nspname, '[\n\r]', ' '),                 regexp_replace(auth.rolname, '[\n\r]', ' '))   from pg_namespace n        join pg_roles auth ON auth.oid = n.nspowner  where nspname <> 'information_schema' and nspname !~ '^pg_';
2024-08-23 00:05:23.800 1 SQL    pgsql.c:1568              [TARGET 503] select oid, format('%I', rolname) as rolname from pg_roles;
2024-08-23 00:05:23.801 1 DEBUG  schema.c:2907             listSourceIndexesSQL[SOURCE_FILTER_TYPE_NONE]
2024-08-23 00:05:23.801 1 SQL    pgsql.c:1568              [TARGET 503]    select i.oid,           format('%I', n.nspname) as inspname,           format('%I', i.relname) as irelname,          r.oid,           format('%I', rn.nspname) as rnspname,           format('%I', r.relname) as rrelname,           indisprimary,          indisunique,          (select string_agg(format('%I', attname), ',')             from pg_attribute            where attrelid = r.oid              and array[attnum::integer] <@ indkey::integer[]          ) as cols,          pg_get_indexdef(indexrelid),          c.oid,          c.condeferrable,          c.condeferred,          case when conname is not null                then format('%I', c.conname)            end as conname,          pg_get_constraintdef(c.oid),          format('%s %s %s',                  regexp_replace(n.nspname, '[\n\r]', ' '),                  regexp_replace(i.relname, '[\n\r]', ' '),                  regexp_replace(auth.rolname, '[\n\r]', ' '))     from pg_index x          join pg_class i ON i.oid = x.indexrelid          join pg_class r ON r.oid = x.indrelid          join pg_namespace n ON n.oid = i.relnamespace          join pg_namespace rn ON rn.oid = r.relnamespace          join pg_roles auth ON auth.oid = i.relowner          left join pg_depend d                  on d.classid = 'pg_class'::regclass                and d.objid = i.oid                and d.refclassid = 'pg_constraint'::regclass                and d.deptype = 'i'          left join pg_constraint c ON c.oid = d.refobjid    where r.relkind = 'r' and r.relpersistence in ('p', 'u')       and n.nspname !~ '^pg_' and n.nspname <> 'information_schema'      and n.nspname !~ 'pgcopydb'      and not exists        (          select 1            from pg_depend d           where d.classid = 'pg_class'::regclass             and d.objid = r.oid             and d.deptype = 'e'        )  order by n.nspname, r.relname, i.relname;
2024-08-23 00:05:23.828 1 SQL    pgsql.c:1568              [TARGET 503] COMMIT;
2024-08-23 00:05:23.829 1 SQL    pgsql.c:410               Disconnecting from [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.829 1 INFO   copydb_schema.c:1538      Found 130 indexes (supporting 52 constraints) in the target database
2024-08-23 00:05:23.830 9 NOTICE cli_clone_follow.c:500    Starting the clone sub-process
2024-08-23 00:05:23.831 9 INFO   cli_clone_follow.c:543    STEP 1: fetch source database tables, indexes, and sequences
2024-08-23 00:05:23.831 9 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/source.db": already opened
2024-08-23 00:05:23.831 9 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/filter.db": already opened
2024-08-23 00:05:23.831 9 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/target.db": already opened
2024-08-23 00:05:23.831 1 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/source.db": already opened
2024-08-23 00:05:23.831 9 DEBUG  catalog.c:634             Catalog has been setup for source "postgres://postgres@localhost:5432/gauntlet", target "postgres://migration@tklier-z4:8543/db", snapshot "00000007-000004E8-1"
2024-08-23 00:05:23.832 10 NOTICE cli_clone_follow.c:704    Starting the follow sub-process
2024-08-23 00:05:23.832 10 DEBUG  catalog.c:794             Skipping opening SQLite database "/work/schema/source.db": already opened
2024-08-23 00:05:23.833 11 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/source.db" with lib version 3.45.1
2024-08-23 00:05:23.833 9 DEBUG  copydb_schema.c:100       --not-consistent, create a fresh connection
2024-08-23 00:05:23.833 9 SQL    pgsql.c:501               Connecting to [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.834 10 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/source.db" with lib version 3.45.1
2024-08-23 00:05:23.835 12 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/source.db" with lib version 3.45.1
2024-08-23 00:05:23.836 12 NOTICE follow.c:895              Starting the transform sub-process
2024-08-23 00:05:23.836 12 DEBUG  ld_stream.c:2755          stream_read_context: waiting for context files to have been created, retrying in 100ms
2024-08-23 00:05:23.841 9 SQL    pgsql.c:1568              [SOURCE 4181759] BEGIN;
2024-08-23 00:05:23.841 9 SQL    pgsql.c:1568              [SOURCE 4181759] select has_database_privilege(current_database(), $1);;
2024-08-23 00:05:23.841 9 SQL    pgsql.c:1581              [SOURCE 4181759] 'create'
2024-08-23 00:05:23.841 9 SQL    pgsql.c:1568              [SOURCE 4181759] select has_database_privilege(current_database(), $1);;
2024-08-23 00:05:23.841 9 SQL    pgsql.c:1581              [SOURCE 4181759] 'temp'
2024-08-23 00:05:23.842 9 SQL    pgsql.c:1568              [SOURCE 4181759] select current_setting('search_path');
2024-08-23 00:05:23.842 9 SQL    pgsql.c:1568              [SOURCE 4181759] set local search_path to pgcopydb, "$user", public;
2024-08-23 00:05:23.842 9 ERROR  catalog.c:889             Failed to attach '/work/schema/source.db' as source
2024-08-23 00:05:23.842 9 ERROR  catalog.c:890             database source is already in use
2024-08-23 00:05:23.842 9 ERROR  cli_clone_follow.c:504    Failed to clone source database, see above for details
2024-08-23 00:05:23.845 13 DEBUG  catalog.c:799             Opening SQLite database "/work/schema/source.db" with lib version 3.45.1
2024-08-23 00:05:23.846 11 NOTICE follow.c:895              Starting the prefetch sub-process
2024-08-23 00:05:23.846 11 INFO   ld_stream.c:2041          Resuming streaming from latest file "/work/cdc/000000010000001F00000031.json"
2024-08-23 00:05:23.848 13 NOTICE follow.c:895              Starting the catchup sub-process
2024-08-23 00:05:23.848 11 INFO   ld_stream.c:656           Resuming streaming at LSN 1F/3109AFF8 from JSON file "/work/cdc/000000010000001F00000031.json"
2024-08-23 00:05:23.848 13 DEBUG  ld_apply.c:348            startpos 1F/3106DBB8 endpos 0/0 apply disabled
2024-08-23 00:05:23.848 11 NOTICE ld_stream.c:662           Resume replication from latest message: {"action":"K","lsn":"1F/3109AFF8","timestamp":"2024-08-23 00:04:37.594956+0000"}
2024-08-23 00:05:23.848 13 INFO   ld_apply.c:362            Waiting until the pgcopydb sentinel apply is enabled
2024-08-23 00:05:23.849 11 SQL    pgsql.c:501               Connecting to [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.854 11 SQL    pgsql.c:1568              [SOURCE 4181760] SELECT restart_lsn FROM pg_replication_slots WHERE slot_name = $1;
2024-08-23 00:05:23.854 11 SQL    pgsql.c:1581              [SOURCE 4181760] 'pgcopydb'
2024-08-23 00:05:23.855 11 SQL    pgsql.c:410               Disconnecting from [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.855 11 NOTICE ld_stream.c:456           Connecting to logical decoding replication stream
2024-08-23 00:05:23.855 11 DEBUG  ld_stream.c:491           startLogicalStreaming: test_decoding (1)
2024-08-23 00:05:23.855 11 SQL    pgsql.c:3865              starting log streaming at 1F/3109AFF8 (slot pgcopydb)
2024-08-23 00:05:23.855 11 SQL    pgsql.c:501               Connecting to [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60&replication=database"
2024-08-23 00:05:23.860 11 SQL    pgsql_timeline.c:75       IDENTIFY_SYSTEM: timeline 1, xlogpos 1F/3109AFF8, systemid 7402707317449469085
2024-08-23 00:05:23.860 11 SQL    pgsql.c:4655              RetrieveWalSegSize: 16777216
2024-08-23 00:05:23.860 11 SQL    pgsql.c:3926              START_REPLICATION SLOT "pgcopydb" LOGICAL 1F/3109AFF8 ("include-xids" 'true')
2024-08-23 00:05:23.861 11 SQL    pgsql.c:3941              streaming initiated
2024-08-23 00:05:23.861 11 DEBUG  ld_stream.c:2641          Wrote wal_segment_size 16777216 into "/work/cdc/wal_segment_size"
2024-08-23 00:05:23.862 11 DEBUG  ld_stream.c:2655          Wrote tli 1 timeline file "/work/cdc/tli"
2024-08-23 00:05:23.862 11 DEBUG  ld_stream.c:1408          streamFlush: 1F/3109AFF8 0/0
2024-08-23 00:05:23.863 11 DEBUG  sentinel.c:555            sentinel_sync_recv: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8
2024-08-23 00:05:23.863 11 DEBUG  ld_stream.c:1610          stream_sync_sentinel: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8 apply_lsn 0/0 startpos 1F/3109AFF8 endpos 0/0 apply disabled
2024-08-23 00:05:23.863 11 DEBUG  sentinel.c:555            sentinel_sync_recv: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8
2024-08-23 00:05:23.863 11 DEBUG  ld_stream.c:1610          stream_sync_sentinel: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8 apply_lsn 0/0 startpos 1F/3109AFF8 endpos 0/0 apply disabled
2024-08-23 00:05:23.863 11 INFO   pgsql.c:4511              Reported write_lsn 1F/3109AFF8, flush_lsn 1F/3109AFF8, replay_lsn 0/0
2024-08-23 00:05:23.937 12 SQL    pgsql.c:501               Connecting to [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:23.982 1 ERROR  cli_clone_follow.c:764    clone process 9 has terminated [6]
2024-08-23 00:05:24.132 1 WARN   cli_clone_follow.c:314    Failed to clone the source database, see above for details
2024-08-23 00:05:24.132 1 FATAL  copydb.c:684              Terminating all processes in our process group
2024-08-23 00:05:24.133 1 DEBUG  copydb.c:712              Waiting for sub-processes to finish
2024-08-23 00:05:24.133 12 DEBUG  ld_transform.c:751        stream_transform_from_queue was asked to stop
2024-08-23 00:05:24.133 13 INFO   ld_apply.c:298            Apply process received a shutdown signal while waiting for apply mode, quitting now
2024-08-23 00:05:24.133 11 DEBUG  ld_stream.c:1408          streamFlush: 1F/3109AFF8 1F/3109AFF8
2024-08-23 00:05:24.133 12 SQL    pgsql.c:410               Disconnecting from [target] "postgres://migration@tklier-z4:8543/db?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
2024-08-23 00:05:24.133 13 NOTICE ld_apply.c:205            Apply mode is still disabled, quitting now
2024-08-23 00:05:24.133 12 INFO   follow.c:771              Transform process has terminated
2024-08-23 00:05:24.134 11 DEBUG  sentinel.c:555            sentinel_sync_recv: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8
2024-08-23 00:05:24.134 11 DEBUG  ld_stream.c:1610          stream_sync_sentinel: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8 apply_lsn 0/0 startpos 1F/3109AFF8 endpos 0/0 apply disabled
2024-08-23 00:05:24.134 11 DEBUG  sentinel.c:555            sentinel_sync_recv: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8
2024-08-23 00:05:24.134 11 DEBUG  ld_stream.c:1610          stream_sync_sentinel: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8 apply_lsn 0/0 startpos 1F/3109AFF8 endpos 0/0 apply disabled
2024-08-23 00:05:24.134 11 INFO   pgsql.c:4511              Reported write_lsn 1F/3109AFF8, flush_lsn 1F/3109AFF8, replay_lsn 0/0
2024-08-23 00:05:24.134 11 DEBUG  pgsql.c:4560              received signal to stop streaming, currently at 1F/3109AFF8
2024-08-23 00:05:24.134 13 INFO   follow.c:824              Apply process has terminated
2024-08-23 00:05:24.135 11 SQL    pgsql.c:410               Disconnecting from [source] "postgres://postgres@localhost:5432/gauntlet?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60&replication=database"
2024-08-23 00:05:24.135 11 DEBUG  ld_stream.c:1408          streamFlush: 1F/3109AFF8 1F/3109AFF8
2024-08-23 00:05:24.135 11 DEBUG  sentinel.c:555            sentinel_sync_recv: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8
2024-08-23 00:05:24.136 11 DEBUG  ld_stream.c:1610          stream_sync_sentinel: write_lsn 1F/3109AFF8 flush_lsn 1F/3109AFF8 apply_lsn 0/0 startpos 1F/3109AFF8 endpos 0/0 apply disabled
2024-08-23 00:05:24.136 11 DEBUG  ld_transform.c:904        Send STOP message to Transform Queue 2
2024-08-23 00:05:24.136 11 INFO   ld_stream.c:518           Streamed up to write_lsn 1F/3109AFF8, flush_lsn 1F/3109AFF8, stopping: endpos is 0/0
2024-08-23 00:05:24.136 11 INFO   follow.c:704              Prefetch process has terminated
2024-08-23 00:05:24.284 10 NOTICE follow.c:1057             Subprocess prefetch with pid 11 has exited successfully
2024-08-23 00:05:24.285 10 NOTICE follow.c:1102             Process prefetch has exited successfully, and endpos is unset: terminating other processes
2024-08-23 00:05:24.285 10 NOTICE follow.c:1151             kill -TERM 12 (transform)
2024-08-23 00:05:24.285 10 NOTICE follow.c:1151             kill -TERM 13 (catchup)
2024-08-23 00:05:24.286 10 NOTICE follow.c:1057             Subprocess transform with pid 12 has exited successfully
2024-08-23 00:05:24.286 10 NOTICE follow.c:1102             Process transform has exited successfully, and endpos is unset: terminating other processes
2024-08-23 00:05:24.287 10 NOTICE follow.c:1151             kill -TERM 13 (catchup)
2024-08-23 00:05:24.288 10 NOTICE follow.c:1057             Subprocess catchup with pid 13 has exited successfully
2024-08-23 00:05:24.288 10 NOTICE follow.c:1102             Process catchup has exited successfully, and endpos is unset: terminating other processes
2024-08-23 00:05:24.438 10 INFO   follow.c:646              Subprocesses for prefetch, transform, and catchup have now all exited
2024-08-23 00:05:24.439 10 INFO   follow.c:418              Catching-up from existing on-disk files
2024-08-23 00:05:24.439 10 ERROR  follow.c:424              Failed to read the streaming context information from the source database and internal catalogs, see above for details
2024-08-23 00:05:24.533 1 ERROR  copydb.c:767              Sub-process 10 exited with code 12
2024-08-23 00:05:24.534 1 DEBUG  copydb.c:728              copydb_wait_for_subprocesses: no more children
2024-08-23 00:05:24.534 1 DEBUG  lock_utils.c:212          ipcrm -s 3
2024-08-23 00:05:24.534 1 DEBUG  lock_utils.c:212          ipcrm -s 2
2024-08-23 00:05:24.534 1 DEBUG  queue_utils.c:60          iprm -q 2 (transform)
2024-08-23 00:05:24.534 1 DEBUG  lock_utils.c:212          ipcrm -s 1
2024-08-23 00:05:24.535 1 DEBUG  queue_utils.c:60          iprm -q 1 (create index)
2024-08-23 00:05:24.535 1 DEBUG  queue_utils.c:60          iprm -q 0 (vacuum)
2024-08-23 00:05:24.535 1 DEBUG  lock_utils.c:212          ipcrm -s 0
@jace-ys
Copy link

jace-ys commented Jan 30, 2025

Also seeing the same issue when using --follow with --filters. Doesn't seem to be an issue without --filters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants