Bug #115073 Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-2 is
Submitted: 22 May 3:10 Modified: 22 May 18:06
Reporter: Jinxiao Zhang Email Updates:
Status: Analyzing Impact on me:
None 
Category:MySQL Operator Severity:S3 (Non-critical)
Version:8.4.0-2.1.3 OS:CentOS (CentOS7)
Assigned to: MySQL Verification Team CPU Architecture:x86
Tags: mysql-innodbcluster

[22 May 3:10] Jinxiao Zhang
Description:

log:
```
[2024-05-22 03:05:34,999] kopf.objects         [ERROR   ] Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-2 is not yet configured
[2024-05-22 03:05:35,105] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'progress': {'on_pod_create': {'started': '2024-05-21T14:12:25.941017', 'stopped': None, 'delayed': '2024-05-22T03:06:05.000402', 'purpose': 'create', 'retries': 1535, 'success': False, 'failure': False, 'message': 'Sidecar of mysql-innodbcluster-2 is not yet configured', 'subrefs': None}}}, None),)
[2024-05-22 03:05:35,200] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'dummy': '2024-05-22T03:05:35.150740'}, None),)
[2024-05-22 03:05:35,232] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
[2024-05-22 03:05:35,326] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
on_pod_create: pod=mysql-innodbcluster-1 ContainersReady=None Ready=None gate[configured]=None
[2024-05-22 03:05:35,347] kopf.objects         [ERROR   ] Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-1 is not yet configured
[2024-05-22 03:05:35,416] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'progress': {'on_pod_create': {'started': '2024-05-21T14:12:25.894039', 'stopped': None, 'delayed': '2024-05-22T03:06:05.348152', 'purpose': 'create', 'retries': 1535, 'success': False, 'failure': False, 'message': 'Sidecar of mysql-innodbcluster-1 is not yet configured', 'subrefs': None}}}, None),)
[2024-05-22 03:05:35,546] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
[2024-05-22 03:06:04,801] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'dummy': '2024-05-22T03:06:04.737517'}, None),)
[2024-05-22 03:06:04,930] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
on_pod_create: pod=mysql-innodbcluster-0 ContainersReady=None Ready=None gate[configured]=None
[2024-05-22 03:06:04,972] kopf.objects         [ERROR   ] Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
[2024-05-22 03:06:05,025] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'progress': {'on_pod_create': {'started': '2024-05-21T14:12:25.930268', 'stopped': None, 'delayed': '2024-05-22T03:06:34.973292', 'purpose': 'create', 'retries': 1536, 'success': False, 'failure': False, 'message': 'Sidecar of mysql-innodbcluster-0 is not yet configured', 'subrefs': None}}}, None),)
[2024-05-22 03:06:05,059] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'dummy': '2024-05-22T03:06:05.001758'}, None),)
[2024-05-22 03:06:05,165] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
[2024-05-22 03:06:05,195] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
on_pod_create: pod=mysql-innodbcluster-2 ContainersReady=None Ready=None gate[configured]=None
[2024-05-22 03:06:05,221] kopf.objects         [ERROR   ] Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-2 is not yet configured
[2024-05-22 03:06:05,365] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'progress': {'on_pod_create': {'started': '2024-05-21T14:12:25.941017', 'stopped': None, 'delayed': '2024-05-22T03:06:35.222460', 'purpose': 'create', 'retries': 1536, 'success': False, 'failure': False, 'message': 'Sidecar of mysql-innodbcluster-2 is not yet configured', 'subrefs': None}}}, None),)
[2024-05-22 03:06:05,393] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'dummy': '2024-05-22T03:06:05.348618'}, None),)
[2024-05-22 03:06:05,495] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
[2024-05-22 03:06:05,522] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
on_pod_create: pod=mysql-innodbcluster-1 ContainersReady=None Ready=None gate[configured]=None
[2024-05-22 03:06:05,549] kopf.objects         [ERROR   ] Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-1 is not yet configured
[2024-05-22 03:06:05,597] kopf.objects         [WARNING ] Patching failed with inconsistencies: (('remove', ('status', 'kopf'), {'progress': {'on_pod_create': {'started': '2024-05-21T14:12:25.894039', 'stopped': None, 'delayed': '2024-05-22T03:06:35.549988', 'purpose': 'create', 'retries': 1536, 'success': False, 'failure': False, 'message': 'Sidecar of mysql-innodbcluster-1 is not yet configured', 'subrefs': None}}}, None),)
[2024-05-22 03:06:05,725] kopf.objects         [INFO    ] Handler 'on_pod_event' succeeded.
```

When creating mysql-innodbcluter after installing mysql-operater the pod is not created.

describe pod:
```
  Error    Logging           8m14s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           7m44s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           7m14s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           6m43s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           6m13s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           5m43s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           5m13s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           4m42s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           4m12s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           3m42s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           3m12s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           2m41s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           2m11s  kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           101s   kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           71s    kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           40s    kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
  Error    Logging           10s    kopf               Handler 'on_pod_create' failed temporarily: Sidecar of mysql-innodbcluster-0 is not yet configured
```

How to repeat:

helm install mycluster mysql-operator/mysql-innodbcluster --namespace mynamespace --create-namespace --set credentials.root.user='root'  --set credentials.root.password='supersecret'  --set credentials.root.host='%' --set serverInstances=3  --set routerInstances=1