kubeflow pipeline ml_metadata mysql_real_connect failed

1.6k views Asked by At

I am trying to build kubeflow pipeline

metadata-deployment

When Kubeflow connected data, the following questions occurred. What do I need to operate? I have now set up the database and the user password is confirmed to be correct

That's official ⬇️

apiVersion: v1
data:
  password: aG05WGJCb2s3ZEdUNDR0eQ==
  username: YWRtaW4=
kind: Secret
metadata:
  name: mysql-credential
  namespace: kubeflow
type: Opaque

------------------
env:
- name: DBCONFIG_USER
  valueFrom:
    secretKeyRef:
      key: username
      name: mysql-credential
- name: DBCONFIG_PASSWORD
  valueFrom:
    secretKeyRef:
      key: password
      name: mysql-credential

And so is my configuration

LOG ERROR

2020-09-27 10:16:51.065292: F ml_metadata/metadata_store/metadata_store_server_main.cc:178] Non-OK-status: ml_metadata::CreateMetadataStore(connection_config, &metadata_store) status: Internal: mysql_real_connect failed: errno: 1045, error: Access denied for user 'admin'@'10.22.0.185' (using password: YES)MetadataStore cannot be created with the given connection config.
1

There are 1 answers

2
Malgorzata On BEST ANSWER

Try to:

  • Check for typo error: username or password.
  • Check the host name and compare it with mysql.user table host name
  • Check user exists or not.
  • Check whether host contains IP address or host name.
  • Check if mysql DB works.
    Run: mysql -D ${MYSQL_DATABASE} -u root -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1' on mysql pod
  • Check that PVC is properly bounded: kubectl get pvc mysql -n kubeflow
  • Check the volume are you using for the mysql PV - If it is local hostPath, try to delete directory on the k8s cluster node

See more: mysql-errno-1045.

Take a look: access-denied-mysql, kubeflow-mysql-pipeline, kubeflow-mysql.