Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Local testing setup for debezium #1178

Open
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

wcmitchell
Copy link
Contributor

Link(s) to Jira

Description of Intent of Change(s)

Preps and sets up local setup for a debezium testing environment

Local Testing

Setup

Stand up the testing environment with docker-compose -f docker-compose-kafka.yml up to get things up and running. This will require an active login to the cloudservices quay.io repository to pull our KafkaConnect image with the necessary connector plugins already installed.

Once the testing environment is up and running, run the the setup_local.py python script in this directory to add the necessary outbox table and wal_level configurations to the RBAC postgres DB and create the debezium-test connector on the local KafkaConnect instance.

Testing

With the above complete, any INSERT into the outbox table will result in a corresponding message to the debezium-testing.public.outbox topic on Kafka. The messages in this topic can be checked with the check_events.sh script, also in this directory.

Checklist

  • if API spec changes are required, is the spec updated?
  • are there any pre/post merge actions required? if so, document here.
  • are theses changes covered by unit tests?
  • if warranted, are documentation changes accounted for?
  • does this require migration changes?
    • if yes, are they backwards compatible?
  • is there known, direct impact to dependent teams/components?
    • if yes, how will this be handled?

Secure Coding Practices Checklist Link

Secure Coding Practices Checklist

  • Input Validation
  • Output Encoding
  • Authentication and Password Management
  • Session Management
  • Access Control
  • Cryptographic Practices
  • Error Handling and Logging
  • Data Protection
  • Communication Security
  • System Configuration
  • Database Security
  • File Management
  • Memory Management
  • General Coding Practices

Signed-off-by: Chris Mitchell <[email protected]>
@wcmitchell wcmitchell force-pushed the local_debezium_testing branch from 5968304 to 39b8fae Compare August 29, 2024 19:50
@astrozzc
Copy link
Contributor

I am running with podman compose but got:

Error response from daemon: {"message":"unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication"}

I tried both podman login registry.redhat.io or podman login quay.io but no help

@astrozzc
Copy link
Contributor

I am running with podman compose but got:

Error response from daemon: {"message":"unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication"}

I tried both podman login registry.redhat.io or podman login quay.io but no help

Still having the same issue. Is it because I am using podman compose instead of docker compose?

@astrozzc
Copy link
Contributor

I am running with podman compose but got:
Error response from daemon: {"message":"unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication"}
I tried both podman login registry.redhat.io or podman login quay.io but no help

Still having the same issue. Is it because I am using podman compose instead of docker compose?

I changed using docker-compose and it works, NVM.
Nice it is working for me

@astrozzc
Copy link
Contributor

Nice! Thanks! Works for me! Keith is still having some issue though

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants