Prerequisites

• The Amazon Aurora MySQL instance is running.

• The MySQL version is 8.0 or higher. You can choose the MySQL version while creating the instance.

• Binary Log (BinLog) replication is enabled on the primary instance of your Amazon Aurora MySQL database server.

  Note: Amazon Aurora MySQL does not support BinLog replication on read replicas.

• Hevo’s IP address(es) for your region is added to the Amazon Aurora MySQL database IP Allowlist.

• The SELECT, RELOAD, SHOW DATABASES, and REPLICATION privileges are granted to the database user.

  Note: We recommend that you create a database user for configuring your Amazon Aurora MySQL Source in Hevo. However, if you already have one, refer to section Grant privileges to the user.

• The database hostname and port number of the Source instance are available.

---

Perform the following steps to configure your Amazon Aurora MySQL Source:

Set up MySQL Binary Logs for Replication

A binary log is a collection of log files that records information about data modifications and data object modifications made on a MySQL server instance. Typically binary logs are used for data replication and data recovery.

Hevo supports data ingestion for replication from MySQL servers via binary logs (BinLog). For this, binary logging must be enabled on your MySQL instance.

To enable binary logging for an Aurora DB cluster, follow these steps:

1. Configure the parameter group

1. Open the Amazon RDS console.

2. In the left navigation pane, click Databases (or Instances if you are using an older version).

3. In the Databases section on the right, click the DB instance that you want to connect.

   

4. Click the Configuration tab, and then click the link text under DB cluster parameter group.

   Note: If you are using the default Aurora DB cluster parameter group, then create a new DB cluster parameter group with Type as DB cluster parameter group.

   

5. Click Edit.

   

6. Update the values of the parameters as follows:

   

   Parameter Name	Value
   binlog_format	ROW
   binlog_row_image	full
   gtid-mode	ON
   enforce_gtid_consistency	ON

   Note:

   • Enabling GTID is recommended because it makes replication simpler and helps ensure that the primary and replica servers are in sync with each other.

   • Ensure that the value of binlog_row_value_options parameter is not set to PARTIAL_JSON.

7. Click Save Changes.

8. Reboot the database instance that you are using to connect to Hevo, to apply the above changes.

   To do this:

   1. In the left navigation pane, under Dashboard, click Databases.

   2. In the Databases section on the right, select the DB identifier of the Aurora MySQL instance you are replicating.

   3. In the Actions drop-down, click Reboot.

      Note: If you reboot a database instance with the Writer instance role in the DB cluster, all the remaining reader instances of that database in the cluster are rebooted as well.

      

   4. On the Reboot DB Instance page, click Confirm to reboot your DB instance.

      

This confirms that binary logging is now enabled for your Aurora MySQL instance.

The replication reference guide on MySQL’s documentation portal provides a complete reference of the options available for replication and binary logging.

2. Configure the BinLog retention period

1. Log in to your Amazon Aurora MySQL database instance with ADMIN privileges.

2. Run the following command to view the current BinLog retention period (in hours):

   call mysql.rds_show_configuration;
   

3. If the BinLog retention period is less than 72 hours, run the following command to set it to at least 72 hours (three days).

   call mysql.rds_set_configuration('binlog retention hours', 72);
   

---

Allowlist Hevo IP addresses for your region

You need to allowlist the Hevo IP address for your region to enable Hevo to connect to your Amazon Aurora MySQL database. To do this:

1. Open the Amazon RDS console.

2. In the left navigation pane, click Databases (or Instances if you’re using an older version)

3. In the Databases section on the right, click the DB identifier of the Amazon Aurora instance to configure a security group on.

   

4. In the Connectivity & security tab, click the link text under Security, VPC security groups.

   

5. On the Security Groups page, select the check box for your Security group ID, and from the Actions drop-down, click Edit inbound rules.

   

6. On the Edit inbound rules page:

   

   1. Click Add rule.

   2. Add a new rule with Hevo’s IP address for your region to give access to the Amazon Aurora MySQL instance.

   3. Click Save rules.

---

Create a Database User and Grant Privileges

1. Create a database user (Optional)

2. Grant privileges to the user

The database user specified in the Hevo Pipeline must have the following global privileges:

• SELECT - Select data from tables in your database which you want to replicate.

• RELOAD - Access to clear or reload internal caches, flush tables, or acquire locks.

• SHOW DATABASES - View list of database names in the server.

• REPLICATION CLIENT - Access to the MySQL server BinLog for replication.

• REPLICATION SLAVE - Access replication status and log details.

Note: The SELECT, RELOAD, and SHOW DATABASES privileges are only required during the historical load.

Perform the following steps to set up these privileges:

1. Connect to your Amazon Aurora MySQL database as a root user with an SQL client tool, such as MySQL workbench.

2. Grant the required privileges to the user:

   GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION CLIENT, REPLICATION SLAVE ON *.* TO <username>@'%';
   

3. Allow Hevo to access your database:

   GRANT SELECT ON <database_name>.* TO <username>;
   

4. Grant privileges to the database user to read BinLog settings:

   GRANT EXECUTE ON PROCEDURE mysql.rds_show_configuration TO '<username>'@'<hostname>';
   

5. Finalize the user’s permissions:

   FLUSH PRIVILEGES;
   

Note: Replace the placeholder values in the commands above with your own. For example, <username> with hevo.

---

Retrieve the Database Hostname and Port Number (Optional)

---