Setup Kafka In Macos

-

OS : MacOS Sonoma - Silicon Chip

Date: 26-April-2025


Install:

brew install kafka


Start Kafka

To start kafka now and restart at login:

  brew services start kafka


Or, if you don't want/need a background service you can just run:

  /opt/homebrew/opt/kafka/bin/kafka-server-start /opt/homebrew/etc/kafka/server.properties


Create Topic

vishesh@visheshs-MacBook-Pro bin % /opt/homebrew/opt/kafka/bin/kafka-topics --create --topic test-topic --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1

Created topic test-topic.


Verify Topic creation

vishesh@visheshs-MacBook-Pro bin % /opt/homebrew/opt/kafka/bin/kafka-topics --list --bootstrap-server localhost:9092

test-topic


Sending Producer

mauli@maulis-MacBook-Pro bin % /opt/homebrew/opt/kafka/bin/kafka-console-producer --bootstrap-server localhost:9092 --topic test-topic

>Hello Mauli

>$(date)

>`date`

>Its fun

mauli@maulis-MacBook-Pro bin % echo "Trying to send Message to topic using Pipe Symbol with correct command" | /opt/homebrew/opt/kafka/bin/kafka-console-producer --bootstrap-server localhost:9092 --topic test-topic

>>%

mauli@maulis-MacBook-Pro bin %


Receiver Consumer

/opt/homebrew/opt/kafka/bin/kafka-console-consumer --bootstrap-server localhost:9092 --topic test-topic --from-beginning 

Hello Mauli

Hello Mauli from consumer

$(date)

`date`

Its fun

Trying to send Message to topic using Pipe Symbol with correct command


Setup topic to send keyvalue style

vishesh@visheshs-MacBook-Pro bin % /opt/homebrew/opt/kafka/bin/kafka-console-producer \

  --bootstrap-server localhost:9092 \

  --topic test-topic \

  --property "parse.key=true" \

  --property "key.separator=:"

>"key1:value1"

>"NAME: VISHESH"

>Hey Vidisha


Setup Topic to receive keyvalue style

vishesh@visheshs-MacBook-Pro bin % /opt/homebrew/opt/kafka/bin/kafka-console-consumer --bootstrap-server localhost:9092 --topic test-topic --from-beginning \

> --property "print.key=true" \

  --property "key.separator= | "

null | Hello Mauli

null | $(date)

null | `date`

null | Its fun

null | Trying to send Message to topic using Pipe Symbol with correct command

"key1 | value1"

"NAME |  VISHESH"

null | Hey Vidisha



Comments

Post a Comment

Popular posts from this blog

Angular Pie Chart

-
Image
To start implementing, visit the below link:  https://www.npmjs.com/package/ng2-charts/v/3.0.0-rc.2 and follow the instructions it mentions, going with the flow I will show you how it impacts your projects File structure: You can install ng2-charts using npm npm install ng2-charts@next --save Effect: Two folders gets added to node_modules You need to install and include Chart.js library in your application (it is a peer dependency of this library) (more info can be found in the official chart.js documentation) npm install chart.js --save API Import import { ChartsModule } from 'ng2-charts'; // In your App's module: imports: [    ChartsModule ] Chart types There is one directive for all chart types: baseChart, and there are 8 types of charts: line, bar, radar, pie, polarArea, doughnut, bubble and scatter.  
Read more

Spring Boot Export Data to Excel Example

-
Image
  Exporting data to Excel documents is a common feature of almost any applications. Through this article, I’m very glad to share with you guys my experience in implementing Excel export function in a Spring Boot application with the help of Apache POI Excel library. Suppose that we have an existing Spring Boot project using Spring Data JPA and Hibernate to access data, Thymeleaf to render the view and MySQL as the database. The code examples below demonstrate how to retrieve information about users from the database, and generate an Excel file which the users can download onto their computers.   1. Code of Entity Classes and Repositories Interfaces We have the  User   entity class that maps to the  users  table in the database, as shown below: And the  Role   entity class that maps to the  roles  table in the database: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 package com.vishesh ;   import javax.persistence.*;   @Entity @Tab...
Read more