AI February 2023

ai@opengauss.org

2 participants
3 discussions

fence模式配置 plpython 报错
by qinhao＠newland.com.cn 14 Feb '23

14 Feb '23

尝试 "全流程AI" 中的 "PLPython Fenced模式" 时，我编译opengauss（版本3.1.1）时已经加了 --with-python选项： ./configure --gcc-version=7.3.0 CC=g++ CFLAGS="-O2 -g3" --prefix=/mnt/disk01/OpenGauss/release-opengauss-server --3rd=/mnt/disk01/OpenGauss/openGauss-third_party_binarylibs_3.1.0 --enable-thread-safety --with-readline --without-zlib --enable-mot --with-python 然后也配置了 unix_socket_directory 启动后也看到了 ”gaussdb fenced UDF master process“ 使用python是从源码编译的3.8.2 ，安装了opengauss的3.1.1的psycopg2 但是尝试create extension时，报下面的错误，编译opengauss时，没有指定plpython为python2还是python3，也不知道怎么指定请问是还有哪一步我没做吗？ [postgres@qinh154 hadb-opengauss]$ ps -ef|grep gaussdb postgres 22400 1 3 15:27 ? 00:00:18 /mnt/disk01/hadb-opengauss/opengauss/bin/gaussdb -D _pg_root postgres 22448 22400 0 15:27 ? 00:00:00 gaussdb fenced UDF master process postgres 24957 19062 0 15:36 pts/0 00:00:00 grep --color=auto gaussdb [postgres@qinh154 hadb-opengauss]$ gsql -p5432 -h127.0.0.1 -WPostgres123 -r gsql ((openGauss 3.1.1 build 6eeaae6b) compiled at 2023-02-13 19:26:56 commit 0 last mr ) Non-SSL connection (SSL connection is recommended when requiring high-security) Type "help" for help. openGauss=# create extension plpython3u; ERROR: new language is not yet supported. openGauss=# create extension plpythonu; ERROR: could not open extension control file: No such file or directory openGauss=# 新大陆软件秦浩 mobile: 17625988619 e-mail:qinhao@newland.com.cn

2 1

执行 gs_dbmind component xtuner train 报错
by qinhao＠newland.com.cn 11 Feb '23

11 Feb '23

你好，之前的错误是因为numpy的版本错误，纠正版本后，仍然有报错，如下：（一定要安装cuda库吗？我的机器是云上虚拟机，没有cuda设备） 2023-02-11 05:01:10.764147: E tensorflow/compiler/xla/stream_executor/cuda/cuda_driver.cc:267] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected 2023-02-11 05:01:10.764322: I tensorflow/compiler/xla/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (qinh154): /proc/driver/nvidia/version does not exist numpy() is only available when eager execution is enabled. Traceback (most recent call last): File "/mnt/disk01/hadb-opengauss/opengauss/bin/dbmind/components/xtuner/tuner/main.py", line 262, in main return procedure_main(mode, db_info, config) File "/mnt/disk01/hadb-opengauss/opengauss/bin/dbmind/components/xtuner/tuner/xtuner.py", line 130, in procedure_main rl_model('train', env, config) File "/mnt/disk01/hadb-opengauss/opengauss/bin/dbmind/components/xtuner/tuner/xtuner.py", line 174, in rl_model rl = RLAgent(env, alg=config['rl_algorithm']) File "/mnt/disk01/hadb-opengauss/opengauss/bin/dbmind/components/xtuner/tuner/algorithms/rl_agent.py", line 33, in __init__ self.agent = self._build_ddpg(nb_actions, nb_states) File "/mnt/disk01/hadb-opengauss/opengauss/bin/dbmind/components/xtuner/tuner/algorithms/rl_agent.py", line 94, in _build_ddpg ddpg.compile(Adam(), metrics=['mae']) File "/mnt/disk01/hadb-opengauss/python3/lib/python3.8/site-packages/rl/agents/ddpg.py", line 79, in compile critic_optimizer = clone_optimizer(optimizer) File "/mnt/disk01/hadb-opengauss/python3/lib/python3.8/site-packages/rl/util.py", line 25, in clone_optimizer params = {k: v for k, v in optimizer.get_config().items()} File "/mnt/disk01/hadb-opengauss/python3/lib/python3.8/site-packages/keras/optimizers/optimizer_experimental/adam.py", line 207, in get_config "learning_rate": self._serialize_hyperparameter( File "/mnt/disk01/hadb-opengauss/python3/lib/python3.8/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 718, in _serialize_hyperparameter return hyperparameter.numpy() 新大陆软件秦浩 mobile: 17625988619 e-mail:qinhao@newland.com.cn

1 0

找不到libcudart.so.11.0、libnvinfer.so.7
by qinhao＠newland.com.cn 10 Feb '23

10 Feb '23

我在按照文档使用示例 61 (opengauss.org) 使用 x-tuner参数调优，执行train时打印下面错误，查网上的文章说要下载cuda库，但是好像很大有4G，要下载其它关联库，请问必须这样做吗？不使用GPU能不能不下载cuda库？ [postgres@qinh154 dbmind]$ gs_dbmind component xtuner train --db-name postgres --db-user postgres --port 5432 --host 172.32.148.154 --host-user postgres Please input the password of database: Please input the password of host: Start to recommend knobs. Just a moment, please. WARN: The database may restart several times during tuning, continue or not [yes|no]:yes The benchmark will start to run iteratively. This process may take a long time. Please wait a moment. 2023-02-10 11:51:59.940951: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /mnt/disk01/hadb-opengauss/opengauss/lib:/usr/lib/oracle/12.2/client64/lib:/mnt/disk01/install-R-dir/lib64/R/lib:/mnt/disk01/ogg-for-pg-21:/mnt/disk01/ogg-for-pg-21/lib:/mnt/disk01/milvus/lib: 2023-02-10 11:51:59.941060: I tensorflow/compiler/xla/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine. 2023-02-10 11:52:02.460544: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /mnt/disk01/hadb-opengauss/opengauss/lib:/usr/lib/oracle/12.2/client64/lib:/mnt/disk01/install-R-dir/lib64/R/lib:/mnt/disk01/ogg-for-pg-21:/mnt/disk01/ogg-for-pg-21/lib:/mnt/disk01/milvus/lib: 2023-02-10 11:52:02.460982: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /mnt/disk01/hadb-opengauss/opengauss/lib:/usr/lib/oracle/12.2/client64/lib:/mnt/disk01/install-R-dir/lib64/R/lib:/mnt/disk01/ogg-for-pg-21:/mnt/disk01/ogg-for-pg-21/lib:/mnt/disk01/milvus/lib: 2023-02-10 11:52:02.461025: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. 新大陆软件秦浩 mobile: 17625988619 e-mail:qinhao@newland.com.cn

2 1

2024

2023

2022

2021

AI February 2023