I am trying to figure out how to modify the quick start example to use a storageclass

[davesargrad]

My storage class is seen below "rook-nfs-share1"

[dsargrad@chad rook]$ k get storageclass
NAME                      PROVISIONER                        RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE
local-storage (default)   kubernetes.io/no-provisioner       Delete          WaitForFirstConsumer   false                  42d
rook-nfs-share1           nfs.rook.io/rook-nfs-provisioner   Delete          Immediate              false                  19h

Typically the way that I would define a PVC that uses this storage class I would to the following:

cat << EOF > nfs-pvc-dyn-example.yaml
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: rook-nfs-pv-claim
spec:
  storageClassName: "rook-nfs-share1"
  accessModes:
    - ReadWriteMany
  resources:
    requests:
      storage: 1Mi
 
EOF

Then I'd reference that as follows:

The strmzi example for establishing a single node kafka is as follows:

cat << EOF > kafka.yaml
apiVersion: kafka.strimzi.io/v1beta2
kind: Kafka
metadata:
  name: my-cluster
spec:
  kafka:
    version: 2.8.0
    replicas: 1
    listeners:
      - name: plain
        port: 9092
        type: internal
        tls: false
      - name: tls
        port: 9093
        type: internal
        tls: true
    config:
      offsets.topic.replication.factor: 1
      transaction.state.log.replication.factor: 1
      transaction.state.log.min.isr: 1
      log.message.format.version: "2.8"
      inter.broker.protocol.version: "2.8"
    storage:
      type: jbod
      volumes:
      - id: 0
        type: persistent-claim
        size: 100Gi
        deleteClaim: false
  zookeeper:
    replicas: 1
    storage:
      type: persistent-claim
      size: 100Gi
      deleteClaim: false
  entityOperator:
    topicOperator: {}
    userOperator: {}
 
EOF

This example references a storage type "jbod", in addition to a type persistent-claim. However it does not seem to allow me to specify a storage class or a named PVC. When I use this the cluster never starts since it pends on the binding of a PVC.

How would I modify this to reference a PVC (or perhaps 2 PVC's - one for zookeeper) such as rook-nfs-pv-claim above, that uses my storage class rook-nfs-share1?

[scholzj]

You can read all about storage configuration in the docs: https://strimzi.io/docs/operators/latest/full/using.html#assembly-storage-str ... in particular, you can use the class field to specify the storage class which should be used. Also, NFS does not work well with Kafka, you should not use it.

[scholzj]

NFS will cause problems when Kafka tries to delete the old log segments regardless the number of brokers. So you should be careful about it.

[davesargrad]

Yay.. got it working:

[davesargrad]

[davesargrad]

@scholzj Ah.. I see.. Well ty.. then I'll have to move to rook/ceph even sooner.

Btw.. I love your support of strimzi.. its a pleasure to see such a dedicated individual.

[davesargrad]

For now.. i'll just use ephemeral. I dont need replication.. and I dont need data to survive a pod death.

[davesargrad]

@scholzj

Hi. So I have an application running in the default namespace.. its trying to connect to the kafka in the kafka namespace..

I am using the following broker address (since its what I saw the sample consumer using: my-cluster-kafka-bootstrap:9092

I have no problem using the sample producer and consumer:

Yet I dont seem to be able to connect to the broker with my app. The only thing that I can imagine is that I need a different service given that they are in different namespaces.

This application (running in a virtualbox VM) has no problem connecting to a broker running in a separate virtualbox VM. In that case I use the following broker address: 192.168.56.102:9092

Suggestions?

• INFO - Attempting connection to broker ['my-cluster-kafka-bootstrap:9092']

[scholzj]

So, the example clients on your screenshots are running in the kafka namespace ... it has the -n kafka there. If you custom app really runs in default namespace, you should add the namespace suffix to the address. E.g. my-cluster-kafka-bootstrap.kafka.svc:9092.

[davesargrad]

Yay.. You da man. That worked.. So far strimzi is pretty awesome. I've used kafka for a while now, but never on k8s.. so nice.