supertest搭建

supertest 搭建

介绍

Superset 是一款由 Airbnb 开源的“现代化的企业级 BI（商业智能） Web 应用程序”，其通过创建和分享 dashboard，为数据分析提供了轻量级的数据查询和可视化方案。
  Superset 的前端主要用到了 React 和 NVD3/D3，而后端则基于 Python 的 Flask 框架和 Pandas、SQLAlchemy 等依赖库，主要提供了这几方面的功能：

• 集成数据查询功能，支持多种数据库，包括 MySQL、PostgresSQL、Oracle、SQL Server、SQLite、SparkSQL 等，并深度支持 Druid。
• 通过 NVD3/D3 预定义了多种可视化图表，满足大部分的数据展示功能。如果还有其他需求，也可以自开发更多的图表类型，或者嵌入其他的 JavaScript 图表库（如 HighCharts、ECharts）。
• 提供细粒度安全模型，可以在功能层面和数据层面进行访问控制。支持多种鉴权方式（如数据库、OpenID、LDAP、OAuth、REMOTE_USER 等）。

官网

Welcome | Superset (apache.org)

安装部署（docker方式安装）

环境

Linux CentOS Linux release 7.9.2009 (Core)

docker安装

Install Docker Engine on CentOS | Docker Documentation

来镜像并启动

 docker run -d -p 8080:8088 --name superset apache/superset

设置本地账户

docker exec -it superset superset fab create-admin \
              --username admin \
              --firstname Superset \
              --lastname Admin \
              --email [email protected] \
              --password admin

将本地数据库加载到最新版本

docker exec -it superset superset db upgrade

加载示例

此步骤由于网络问题会出错，解决方法看排错部分

 docker exec -it superset superset load_examples

设置角色

docker exec -it superset superset init

登录访问：

http://xxx.xxx.xxx.xxx:8080 账号密码admin/admin

问题排查

问题1

加载示例报错

Creating a World's Health Bank dashboard
Loading [Birth names]
Traceback (most recent call last):
  File "/usr/local/bin/superset", line 33, in <module>
    sys.exit(load_entry_point('apache-superset', 'console_scripts', 'superset')())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/flask/cli.py", line 586, in main
    return super(FlaskGroup, self).main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/flask/cli.py", line 426, in decorator
    return __ctx.invoke(f, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/app/superset/cli.py", line 193, in load_examples
    load_examples_run(load_test_data, load_big_data, only_metadata, force)
  File "/app/superset/cli.py", line 137, in load_examples_run
    examples.load_birth_names(only_metadata, force)
  File "/app/superset/examples/birth_names.py", line 112, in load_birth_names
    load_data(tbl_name, database, sample=sample)
  File "/app/superset/examples/birth_names.py", line 68, in load_data
    pdf = pd.read_json(get_example_data("birth_names2.json.gz"))
  File "/app/superset/examples/helpers.py", line 72, in get_example_data
    content = request.urlopen(  # pylint: disable=consider-using-with
  File "/usr/local/lib/python3.8/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/local/lib/python3.8/urllib/request.py", line 525, in open
    response = self._open(req, data)
  File "/usr/local/lib/python3.8/urllib/request.py", line 542, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/usr/local/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.8/urllib/request.py", line 1397, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
  File "/usr/local/lib/python3.8/urllib/request.py", line 1358, in do_open
    r = h.getresponse()
  File "/usr/local/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/local/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/local/lib/python3.8/http/client.py", line 285, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

解决方法：

网络问题，可下载到本地然后修改相关配置文件进行本地加载

1 下载示例

https://gitcode.net/mirrors/apache-superset/examples-data?utm_source=csdn_github_accelerator
或
https://github.com/apache-superset/examples-data

2 解压数据

unzip examples-data-master.zip

3 使用python起一个http服务

$ cd examples-data-master

$ python3 -m http.server 7887

Serving HTTP on 0.0.0.0 port 7887 (http://0.0.0.0:7887/) ...

4 重启 superset_init 服务，并修改python源码。假设主机iP是192.168.47.202

sed -i 's/BASE_URL = .*"/BASE_URL = "http:\/\/192.168.47.202:7887\/"/g' superset/examples/helpers.py

sed -i 's/https:\/\/github.com\/apache-superset\/examples-data\/raw\/master\//http:\/\/192.168.47.202:7887\//g' superset/examples/configs/datasets/examples/*.yaml

sed -i 's/http:\/\/192.168.3.20:7887\//http:\/\/192.168.47.202:7887\//g' superset/examples/configs/datasets/examples/*.yaml

sed -i 's/https:\/\/raw.githubusercontent.com\/apache-superset\/examples-data\/master\//http:\/\/192.168.47.202:7887\//g' superset/examples/configs/datasets/examples/*.yaml

sed -i 's/https:\/\/raw.githubusercontent.com\/apache-superset\/examples-data\/lowercase_columns_examples\/datasets\/examples\//http:\/\/192.168.47.202:7887\/datasets\/examples/\//g' superset/examples/configs/datasets/examples/*.yaml

exit

5 再次重启superset_init 服务

$ docker restart superset_init 

6 执行等待加载示例结束

 docker exec -it superset superset load_examples

问题2

上传csv文件提示

ERROR: No database is allowed for your csv upload

解决方法

数据库没有开放相关权限，开放相关权限即可

点击 【Data】——》【Databases】——》【Edit】

ity】
点击 【ADVANCED】——》【Security】

勾选【Allow data upload】点击保存

参考

apache/superset - Docker Image |码头工人中心

ERROR: No database is allowed for your csv upload · Issue #10304 · apache/superset · GitHub

superset加载示例数据load_examples报错_软件1024的博客-CSDN博客