Skip to content

fix(deps): add rocksdb 8.1.1 static library and headers for LoongArch#30989

Open
yangwenqing wants to merge 253 commits into
taosdata:3.0from
yangwenqing:fix_loongarch_build_error
Open

fix(deps): add rocksdb 8.1.1 static library and headers for LoongArch#30989
yangwenqing wants to merge 253 commits into
taosdata:3.0from
yangwenqing:fix_loongarch_build_error

Conversation

@yangwenqing

Copy link
Copy Markdown

Description

Fixes #30980.

Checklist

Please check the items in the checklist if applicable.

  • Is the user manual updated?
  • Are the test cases passed and automated?
  • Is there no significant decrease in test coverage?

@yangwenqing

Copy link
Copy Markdown
Author

@guanshengliang 我有兴趣做TDengine 后续的龙架构维护,目前由于缺少libdmodule.a 导致编译失败,希望能得到相应的支持。

@yangwenqing yangwenqing force-pushed the fix_loongarch_build_error branch from 803321a to ba423a0 Compare May 7, 2025 07:21
@yangwenqing yangwenqing closed this May 7, 2025
@yangwenqing yangwenqing reopened this May 7, 2025
@yangwenqing yangwenqing changed the base branch from main to 3.0 May 7, 2025 07:29
guanshengliang and others added 20 commits March 22, 2026 21:23
* feat: Windows adaptation with winsw service registration and bilingual documentation

* fix: remove unused global declaration in parse_arguments function

* style: fix code quality issues detected by ruff

- Remove unused imports (pathlib.Path, json, torch, keras)
- Fix f-string without placeholders
- Remove unused variables (proc)
- Fix indentation errors
- Clean up trailing whitespace and blank lines
- Fix line length issues (>120 chars)
- Add noqa comments for intentional violations

* chore: remove obsolete taosanode.ini configuration file

* refactor: extract ISS and XML templates to separate files

- Move Inno Setup script to templates/tdgpt.iss
- Move WinSW config to templates/taosanode-service.xml
- Implement local WinSW.exe caching (packaging/bin/)
- Add .gitignore to exclude cached binaries
- Simplify win_release.py by using template files

Benefits:
- Easier to maintain ISS and XML files
- No need to escape quotes in Python
- WinSW binary cached locally for faster builds
- Better separation of concerns

* refactor: rename templates to installer and consolidate gitignore

- Rename packaging/templates/ to packaging/installer/ (more descriptive)
- Remove tools/tdgpt/.gitignore (redundant)
- Add WinSW.exe exclusion to community/.gitignore
- Update win_release.py to use new directory name

The 'installer' name better reflects the content:
- tdgpt.iss: Inno Setup installer script
- taosanode-service.xml: Windows service configuration

* fix: improve packaging script robustness

1. Fix GBK encoding issue in install.bat
   - Replace ✓ symbol with [OK] text
   - Prevents crash on Windows with GBK encoding

2. Make model directory optional in ISS
   - Add 'skipifsourcedoesntexist' flag
   - Allow packaging without model files

3. Remove ZIP fallback logic
   - Fail fast if Inno Setup compilation fails
   - Return proper exit code (1) on failure
   - Provide clear error messages

4. Remove unused zipfile import

These changes ensure the packaging script fails clearly
when prerequisites are missing, rather than silently
creating incomplete packages.

* fix: revert model directory to required and add validation

Model directory is REQUIRED for Windows production packaging,
not optional. The previous 'skipifsourcedoesntexist' was only
meant for testing purposes.

Changes:
- Revert ISS to require model directory with DirExists check
- Add validation in win_release.py before building
- Provide clear error message with usage example
- Fail fast if model directory is missing or empty

This ensures users get clear feedback when model files
are missing, rather than cryptic Inno Setup errors.

* feat: add --skip-model-check for testing workflow

Add flexible model validation to support both testing and production:

Testing mode (--skip-model-check):
- Skip model validation for quick testing
- ISS uses 'skipifsourcedoesntexist' to allow empty model dir
- Shows warning that this is for testing only

Production mode (default):
- Validates model directory exists and has files
- Checks for required files: timemoe.tar.gz, tdtsfm.tar.gz
- Fails with clear error if requirements not met
- Ensures production packages always have models

Usage:
  # Testing (no models needed)
  python win_release.py -e community -v 3.3.6.0 --skip-model-check

  # Production (models required)
  python win_release.py -e community -v 3.3.6.0 -m /path/to/models

* fix: update model paths in README-CN for packaging instructions

* docs: update packaging documentation with --skip-model-check

Add documentation for the new --skip-model-check parameter:

- Explain testing vs production modes
- Document required model files (timemoe.tar.gz, tdtsfm.tar.gz)
- Update usage examples to show both modes
- Add warning that --skip-model-check is for testing only
- Update parameter table with new option

Both English and Chinese documentation updated.

* enh:add installation, uninstallation, and log viewer scripts for TDGPT on Windows

* enh: auto-detect installation directory and update paths for Windows compatibility

* Refactor and localize logging and service management in TDGPT

- Removed the log_viewer.py script as it is no longer needed.
- Updated taosanode_service.py to improve cross-platform support and logging consistency.
- Changed log file names to unify logging across services.
- Enhanced uninstall.py for better user experience and clearer output messages.
- Improved uninstall.sh to preserve local configuration while removing global config.

* feat: add Windows installation script and documentation for TDGPT

* fix: update version number in packaging scripts and documentation to 3.4.0.11

* Refactor taosanode service logging and Windows service management

- Introduced a dedicated service log file for taosanode.
- Added functionality to redirect stdout/stderr to a specified file when running under WinSW.
- Updated virtual environment paths to be more organized under a 'venvs' directory.
- Enhanced the uninstall script to improve logging and user feedback.
- Streamlined the removal of files and directories during uninstallation.
- Adjusted configuration paths to align with the new directory structure.
- Improved test configuration to reflect changes in virtual environment paths.

* Refactor taosanode_service.py to improve model management and logging

- Updated model-start command help text for clarity.
- Introduced DEFAULT_MODEL_ORDER for consistent model ordering.
- Added support for loading enabled models from a configuration file.
- Adjusted model configurations for moirai and moment to use smaller default models.
- Enhanced model startup and shutdown processes to skip missing directories and log detailed summaries.
- Improved status reporting for running models.
- Refactored uninstall.py to handle logging based on environment variable.
- Made torch and keras imports optional in conf.py to avoid runtime errors if not available.

* feat: add Python version check and error handling to installer scripts

* fix: update model installation options and logic in installer script

* fix(tdgpt): restore windows startup diagnostics

* fix(tdgpt): limit winsw restart retries

* fix(tdgpt): reuse healthy venvs on online install

* fix(tdgpt): retry progress file writes on windows

* fix(tdgpt): switch installer progress to append-only log

* fix(tdgpt): raise installer disk space estimate

* fix(tdgpt): rebuild incomplete reused main venv

* fix(tdgpt): add detailed startup dependency probes

* fix(tdgpt): improve reinstall and startup diagnostics

* fix(tdgpt): require vc++ runtime before install

* feat(tdgpt): default start-model to all

* feat(tdgpt): confirm existing install directory

* fix(tdgpt): stop winsw before reinstall

* fix(tdgpt): retry rate-limited model downloads

* fix(tdgpt): reuse existing online model directories

* feat(tdgpt): prefer offline model install flow

* feat(tdgpt): update model ports and enhance installation logging

* feat(tdgpt): enhance taosanode startup process and readiness checks

* fix(tdgpt): improve logger setup to handle non-writable log directories

* feat(tdgpt): update dependency installation and enhance logging configuration for GitHub Actions

* feat(tdgpt): enhance Windows and GitHub Actions compatibility in taosanode configuration

* fix(tdgpt): correct model service start assertion for missing required model

* docs(tdgpt): update installation and usage documentation for clarity and consistency

* chore: remove outdated documentation files for doc-writing skill

---------

Co-authored-by: support-platform <it@taosdata.com>
…aosdata#34847)

* fix: failed compress cases on windows

test_compress_basic.py
test_compress_alter_table.py

* fix ai review comments
…34902)

- Add IDLE_TIMEOUT(duration_time) option to STREAM_OPTIONS for
  configuring partition idle detection (valid range: [1s, 10d])
- Add IDLE and RESUME event types to EVENT_TYPE option
- Track per-partition last-receive time using monotonic clock to
  detect idle state transitions (ACTIVE -> IDLE -> ACTIVE)
- Trigger IDLE event once when a partition exceeds idle timeout;
  trigger RESUME event immediately when idle partition receives data
- Provide _tidlestart/_tidleend placeholders for idle/resume
  computation SQL (ns precision; incompatible with _twstart/_twend)
- Add idle/resume fields to notification payload: idleStart,
  idleEnd, idleDurationMs; IDLE and RESUME share the same triggerId
- Add system test: test/cases/18-StreamProcessing/04-Options/
  test_idle_trigger.py covering basic detection, resume, multiple
  partitions, timeout config, placeholder values, event combinations
- Update zh/en SQL reference and advanced-usage docs; add IDLE,
  IDLE_TIMEOUT, RESUME to reserved keywords list (3.3.4.0+)

Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
* hot_update init

* feat: show status and version during rolling update

* stage: hot_update project finished

* rename hot_update to CompatiCheck

* feat: add hot_upgrade_task.py

* fix: cold upgrade finishe and add 0x141 compatible code

* feat: show log path if failed

* tidy up main function finish

* feat: support cold from base to build version

* feat: ci hot/cold update tools finished

* docs: README for CompactCheck

* docs: README for CompactCheck

* submit readme for CompatCheck

* feat: support  compatible ci test

* fix: .github repo branch switch to compat_branch

* fix: check green_versions with file size not exists

* test: only reserver 4 cases for test

* fix: remove oss version code

* fix: docker run

* fix: command show

* fix: remove find path in clusterSetup

* no --rm docker container for test

* fix: taosd start in cluster dnode manger

* fix: 3.3.x.x and 3.4.x.x two group run options

* fix: -V required argument

* fix: chomd 7777 to greeen version

* fix: change green_versions folder

* fix: taosd can not running

* fix: security map to docker folder path

* fix: remove wordir to old position

* fix: docker use netstat replace ss get netstat

* fix: add colon before 6030

* test: version.cmake change to 3.4.0.10 from 3.4.1.0

* fix: add build dir

* fix: reset cases.task and version.cmake

* 3.4.0.0->3.4.1.0 check with --check-sys-info options

* fix: add white list 3.4.0~3.4.1.yaml

* ew-framework-test.yml@compat_branch -> main branch

* rename: CompatCheck->compat-check CompatCI->compat-ci

* fix: change branch github repo to main and ready to merge pr

* fix: markdown format error

---------

Co-authored-by: taos-support <it@taosdata.com>
* docs(mqtt): add failover broker addresses support

Closes: [6625571859](https://project.feishu.cn/taosdata_td/feature/detail/6625571859)

Restructure the MQTT connector configuration documentation to reflect
new failover broker address capabilities. Split the original "connection
and authentication" section into separate "Broker address", "Connection
configuration", and "Authentication configuration" sections for better
clarity.

Add new screenshots (mqtt-04.png, mqtt-collect.png) and update existing
ones (mqtt-03.png, mqtt-05.png) to match the new UI layout. Update step
numbering throughout the document to accommodate the new structure.

Key changes include:
- Separate broker address configuration (step 3)
- Dedicated connection settings section with MQTT protocol version,
  Client ID, Keep Alive, Clean Session, and user properties (step 4)
- Standalone authentication section for credentials and TLS (step 5)
- Enhanced collection configuration with subscription user properties
  and initial position settings for TSDB Bnode (step 6)

* docs(mqtt): improve Keep Alive description and fix minor text issues
hrchen and others added 20 commits May 23, 2026 14:11
The following commits could not be applied individually due to context
differences between the monorepo and the public repo's build files.
They have been applied as a cumulative diff to ensure the final state
matches the monorepo exactly:

- chore: sync CI files with 3.0 branch to eliminate merge conflicts (rd-public/tsdb!271)
- revert(refactor): dynamically link taosd taosudf taosmqtt against libtaosnative.so to reduce binary size (revert taosdata#183) (rd-public/tsdb!282)
- fix(docs): autofix formatting issues across all doc files (rd-public/tsdb!296)
- feat: support -DBUILD_SANITIZER=true on windows for debug build (rd-public/tsdb!291)
- feat(build): build cache, mirror, and sccache optimizations (rd-public/tsdb!326)
- docs: update image for three replica (rd-public/tsdb!324)
- enh: shared storage on windows (rd-public/tsdb!333)
- fix(cmake): convert ext_libs3 from git clone to URL tarball download (rd-public/tsdb!360)
- feat: dual-source deps and comprehensive docs/packaging (cherry-pick to main) (rd-public/tsdb!352)
- fix(cmake): guard DOWNLOAD_EXTRACT_TIMESTAMP for CMake < 3.24 and fix duplicate Cargo.lock entry (rd-public/tsdb!369)
- fix: test case execution failure in pytest.sh (rd-public/tsdb!338)
- enh: built-in compilation support for Python UDF plugins use abi3 (rd-public/tsdb!325)
@guanshengliang

Copy link
Copy Markdown
Contributor

@yangwenqing 不好意思,最近没有关注到这个 PR。你方便留下微信号,以便我和你沟通吗

@yangwenqing yangwenqing requested a review from a team as a code owner May 25, 2026 03:10
@yangwenqing

Copy link
Copy Markdown
Author

您添加 BosonNeverJumpSmash 即可

@yangwenqing 不好意思,最近没有关注到这个 PR。你方便留下微信号,以便我和你沟通吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

how can I get libdmodule.a during compling TDengine from source on LoongArch platform