Stopping the Database Event Consumer

You must stop the database event consumer (Kafka Scheduler) so that you can record its offsets for use later in this process.

  1. Log in to the primary node of the ArcSight Database.
  2. To stop the database watchdog service, run the following command:
    /opt/arcsight-db-tools/scripts/watchdog.sh disable
  3. To stop the Kafka scheduler for the database, run the following command:
    /opt/arcsight-db-tools/kafka_scheduler stop

  4.  To record the offset values for each partition into a db_scheduler_offset.csv file, run the following command:
    /opt/vertica/bin/vsql -U {dbadmin_user_name} -w {dbadmin_user_password} -F ',' -P footer=off -Aqc "select source_partition as partition, LastEndOffset as offset, 'DB' as ConsumerType, LastFrame as time from (select source_name, source_cluster, source_partition, max(end_offset) as LastEndOffset, max(frame_start) as LastFrame from default_secops_adm_scheduler.stream_microbatch_history group by 1,2,3 order by 1 asc, 2 asc, 3 asc) as A order by 1 asc;" > db_scheduler_offset.csv

    You will use this db_scheduler_offset.csv file to record the offset values for the mf-event-avro-enriched topic in a future step.

  5. Copy the db_scheduler_offset.csv file to a cluster Master node.