Skip to content

feat: auto Feature Engineering#2381

Merged
vagetablechicken merged 8 commits into4paradigm:mainfrom
explcre:main
Oct 18, 2022
Merged

feat: auto Feature Engineering#2381
vagetablechicken merged 8 commits into4paradigm:mainfrom
explcre:main

Conversation

@explcre
Copy link
Contributor

@explcre explcre commented Aug 21, 2022

  • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
    2022 gitlink code link
    Auto Feature Engineering.

  • What is the current behavior? (You can also link to an open issue here)

  • What is the new behavior (if this is a feature change)?

  • Developed an automated feature engineering pipeline, including feature generation and selection, based on AutoX and
    OpenMLDB sql with Python.
  • The program automatically generates sql query which meets OpenMLDB standard and get data from it through web request.
  • The data is transformed by OpenMLDB sql to get time series and statistics features, and then we select the most important k
    features based on some algorithms.

@github-actions github-actions bot added the sdk openmldb java/python sdk label Aug 21, 2022
@codecov
Copy link

codecov bot commented Aug 21, 2022

Codecov Report

Base: 75.61% // Head: 75.60% // Decreases project coverage by -0.01% ⚠️

Coverage data is based on head (34b3519) compared to base (ba29780).
Patch has no changes to coverable lines.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2381      +/-   ##
============================================
- Coverage     75.61%   75.60%   -0.02%     
  Complexity      392      392              
============================================
  Files           644      644              
  Lines        121410   121410              
  Branches       1060     1060              
============================================
- Hits          91807    91789      -18     
- Misses        29366    29384      +18     
  Partials        237      237              
Impacted Files Coverage Δ
...s/query_response_time/deploy_query_response_time.h 81.25% <0.00%> (-18.75%) ⬇️
...atistics/query_response_time/query_response_time.h 78.26% <0.00%> (-4.35%) ⬇️
src/rpc/rpc_client.h 85.13% <0.00%> (-4.06%) ⬇️
.../query_response_time/deploy_query_response_time.cc 97.10% <0.00%> (-2.90%) ⬇️
src/sdk/db_sdk.cc 66.14% <0.00%> (-0.45%) ⬇️
src/catalog/client_manager.cc 42.20% <0.00%> (-0.29%) ⬇️
src/nameserver/name_server_impl.cc 43.56% <0.00%> (-0.13%) ⬇️
src/client/tablet_client.cc 57.43% <0.00%> (-0.12%) ⬇️
src/tablet/tablet_impl.cc 62.65% <0.00%> (ø)
hybridse/src/vm/runner.cc 68.11% <0.00%> (+0.03%) ⬆️
... and 2 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 21, 2022

Linux Test Report

568 tests   561 ✔️  26m 13s ⏱️
  57 suites      7 💤
  51 files        0

Results for commit 34b3519.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 21, 2022

SDK Test Report

  83 files    83 suites   1m 44s ⏱️
174 tests 168 ✔️ 6 💤 0
220 runs  214 ✔️ 6 💤 0

Results for commit 34b3519.

♻️ This comment has been updated with latest results.

@tobegit3hub tobegit3hub changed the title feat: Auto Feature Engineering feat: auto Feature Engineering Aug 23, 2022
@dl239
Copy link
Collaborator

dl239 commented Sep 1, 2022

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

@vagetablechicken
Copy link
Collaborator

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

It will take so many dependencies. It' better to be a standalone project

@vagetablechicken vagetablechicken enabled auto-merge (squash) October 18, 2022 07:09
@vagetablechicken vagetablechicken merged commit 3786fcd into 4paradigm:main Oct 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sdk openmldb java/python sdk

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants