DBConvert Streams logo
DBConvert Streams
Preview of the Vultr management interface for DBConvert Streams on a mobile device.
DBConvert Streams logo|trans
DBConvert Streams
Preview of the Vultr server deploy page control panel for DBConvert Streams on a web browser.

DBConvert Streams

Introduction

DBConvert Streams is a powerful platform that simplifies database migration and real-time replication. Whether you're moving data between different database types or need continuous synchronization, DBConvert Streams provides an intuitive solution that reduces complexity while maintaining enterprise-grade reliability.

Core Capabilities

Real-time Replication

Keep your databases synchronized with continuous, low-latency Change Data Capture (CDC):
- Zero-downtime synchronization
- Capture all database changes (INSERT, UPDATE, DELETE operations)
- Minimal impact on source database performance
- Ideal for real-time analytics, disaster recovery, or distributed systems

Data Migration

Transfer data between databases efficiently and reliably:
- Automatic schema conversion between different database types
- Intelligent data chunking for optimal performance
- Real-time progress monitoring
- Perfect for database upgrades, cloud migrations, or development environments

Perfect Integration with Vultr Managed Databases

DBConvert Streams seamlessly connects with Vultr Managed Databases:
- Direct integration with Vultr MySQL (Version 8)
- Full support for Vultr PostgreSQL (Versions 13-17)
- Simplifies data migration to and from Vultr Managed Databases
- Enables real-time replication between Vultr and external databases
- Ideal for cloud migrations to Vultr's infrastructure

Supported Databases

Fully Tested and Supported

  • MySQL
  • PostgreSQL
  • Cloud Databases:
    • Vultr Managed Databases
    • Amazon RDS/Aurora (MySQL and PostgreSQL)
    • Google Cloud SQL
    • Azure Database
    • Digital Ocean Managed Databases

System Requirements

  • CPU: 1+ cores (2+ recommended for production)
  • RAM: 2GB minimum (4GB+ recommended for production)
  • Storage: 1GB minimum for application, additional space for data
  • Operating System: Linux (AMD64, ARM64)

Installation on Vultr

  1. Deploy the DBConvert Streams One-Click App from the Vultr Marketplace
  2. Connect to your instance via SSH
  3. The application will be automatically installed during the deployment process
  4. Access the web interface at http://your-server-ip

Getting Started with Vultr Managed Databases

  1. Create Vultr Managed Databases:

    • Navigate to the Databases section in your Vultr dashboard
    • Select MySQL or PostgreSQL as your database engine
    • Configure your database settings
  2. Connect DBConvert Streams to Vultr Managed Databases:

    • In DBConvert Streams, create a new database connection
    • Enter your Vultr database connection details
    • Test and save the connection
  3. Set Up Streams with Vultr Databases:

    • Create streams using Vultr Managed Databases as source or target
    • Configure replication or migration settings
    • Start your data transfers

Deployment Architecture

DBConvert Streams consists of several containerized services:

  1. Core Services:

    • Stream API: REST API for managing database connections and streams
    • Stream Reader: Source database reader
    • Stream Writer: Target database writer
    • Web Interface: Browser-based management dashboard
  2. Infrastructure Services:

    • NATS: Message streaming and service communication
    • Consul: Service discovery and configuration storage
    • Vault: Secure credentials management

Support

For technical issues or questions, please contact:
- Email: streams@dbconvert.com
- GitHub: https://github.com/slotix/dbconvert-streams-public

Documentation

For comprehensive documentation, please visit:
- https://stream.dbconvert.com/docs/

DBConvert Streams - Installation Guide for Vultr

This guide will walk you through the process of deploying and configuring DBConvert Streams on Vultr.

Deployment Options

DBConvert Streams can be deployed on Vultr in two ways:

  1. Vultr Marketplace One-Click App (recommended for quick setup)
  2. Manual Installation on a Vultr instance

Option 1: Deploying from Vultr Marketplace

Step 1: Deploy the One-Click App

  1. Log in to your Vultr account
  2. Navigate to the Marketplace
  3. Search for "DBConvert Streams" and select it
  4. Choose your preferred server options:
    • Select a plan with at least 2GB RAM and 2 CPU
    • Choose your preferred region
    • Set additional options as needed
  5. Click "Deploy Now"

Step 2: Access Your Instance

  1. Wait for the deployment to complete (~5-10 minutes)
  2. Note your server's IP address from the Vultr dashboard
  3. Connect to your server via SSH:

ssh root@your-server-ip

Step 3: Complete Setup

  1. Once deployed, access the DBConvert Streams by navigating to:

- UI: http://your-server-ip
- API: http://your-server-ip/api/

Option 2: Manual Installation on Vultr

Read more at https://docs.dbconvert.com/deployment/vultr.html

Connecting to Vultr Managed Databases

Setting Up Vultr Managed Database

  1. In your Vultr dashboard, navigate to "Products" > "Databases"
  2. Click "Deploy Database"
  3. Select your preferred database type (MySQL or PostgreSQL)
  4. Choose a plan, region, and other settings
  5. Click "Deploy Now"
  6. Once deployed, note your database connection details:
    • Database hostname
    • Database port
    • Username
    • Password
    • Database name

Configuring Database Connection in DBConvert Streams

  1. In the DBConvert Streams UI, go to "Connections" and click "New Connection"
  2. Select your database type (MySQL or PostgreSQL)
  3. Enter your Vultr Managed Database connection details:
    • Server: Your database hostname (from Vultr dashboard)
    • Port: Database port (typically 3306 for MySQL, 5432 for PostgreSQL)
    • User ID: Your database username
    • Password: Your database password
    • Database: Your database name
  4. Enable SSL if required
  5. Test the connection and save

Special Configuration for CDC Mode

For MySQL CDC:

  1. In your Vultr dashboard, navigate to your MySQL database
  2. Go to "Settings" and ensure binary logging is enabled
  3. Create a parameter group with:
    • binlog_format = ROW
    • binlog_row_image = FULL
  4. Apply the parameter group to your database
  5. Grant appropriate privileges to your database user:

sql GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'username'@'%'; GRANT SELECT ON database_name.* TO 'username'@'%'; FLUSH PRIVILEGES;

For PostgreSQL CDC:

  1. In your Vultr dashboard, navigate to your PostgreSQL database
  2. Create a custom parameter group with:
    • wal_level = logical
    • max_replication_slots = 5 (or higher)
    • max_wal_senders = 10 (or higher)
  3. Apply the parameter group to your database
  4. Connect to your PostgreSQL database and run:

sql ALTER ROLE username WITH REPLICATION; GRANT SELECT ON ALL TABLES IN SCHEMA public TO username;

Creating and Monitoring Streams

Creating Your First Stream

  1. In the DBConvert Streams UI, click "Create Stream"
  2. Select your source database connection
  3. Choose the tables you want to replicate
  4. Select the data transfer mode:
    • Convert: For one-time migration
    • CDC: For continuous replication
  5. Select your target database connection
  6. Click "Save" and then "Start" to begin data transfer

Monitoring Stream Progress

  1. View real-time statistics on the stream details page
  2. Monitor the number of events processed
  3. Check system logs for detailed information

Support Information

Support Contact

Website
https://streams.dbconvert.com
Email
streams@dbconvert.com
Support URL
https://streams.dbconvert.com/contact
Repository
https://github.com/slotix/dbconvert-streams-public
Twitter
dbconvert

Maintainer Contact

Report Application

Report an application with malicious intent or harmful content.

Thank you for your report!

Our Team has received your report and will respond accordingly as possible.