Abstract: This detailed guide provides a step-by-step walkthrough for deploying and verifying Apache DolphinScheduler 3.2.0 in a single-node environment. It includes system requirements, installation instructions, configuration tips, and a full test report to ensure successful implementation.
Keywords: Apache DolphinScheduler, Single-node Deployment, Workflow Orchestration, Data Scheduling, Test Verification
Industry Context and Version Overview
Apache DolphinScheduler has emerged as a leading open-source workflow orchestration platform, particularly favored for its powerful DAG visualization and low-code approach. The 3.2.0 release marks a significant milestone with enhanced features and improved support for domestic databases like Dameng, addressing localization requirements in various regions.
(Important Note: While our tests confirm full functionality of the 3.2.0 single-node deployment, the community currently recommends version 3.1.9 for production environments due to its proven stability.)
Deployment Environment Specifications
- Java Version: 1.8.0_181 (Oracle JDK recommended)
- Operating System: CentOS Linux release 7.6.1810 (64-bit)
- Database: MySQL 5.7.22-22-log (with MySQL Driver 8.0.16)
- Hardware: Minimum 4GB RAM, 2 CPU cores recommended
Key Features in Version 3.2.0
- Enhanced support for domestic database systems
- Improved security configurations with Actuator disablement
- Optimized Python 3.0+ integration for task execution
- Refined Docker image management and tagging system
- Advanced workflow abstraction for diverse runtime environments
Comprehensive Deployment Process
1. Package Preparation
Download the latest release from the official website and extract:
tar -xvzf apache-dolphinscheduler-3.2.0-bin.tar.gz
2. Database Configuration
Set up a dedicated MySQL instance with proper permissions:
CREATE DATABASE dolphinscheduler DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL PRIVILEGES ON dolphinscheduler.* TO 'ds_user'@'%' IDENTIFIED BY 'secure_password';
FLUSH PRIVILEGES;
3. Environment Configuration
Modify critical parameters in dolphinscheduler_env.sh
:
- Database connection details (host, port, credentials)
- JVM memory allocation parameters
- Python and Java environment paths
Verification and Testing
After successful installation, conduct these verification steps:
- Check service status through the web interface
- Validate version information display
- Execute sample workflows (SQL, HTTP, Python tasks)
- Test alerting and notification systems
- Verify database persistence after restarts
Advanced Configuration Tips
- For production environments, consider implementing:
- Regular database backups
- Resource isolation for critical workflows
- Integration with existing monitoring systems
- Leverage the new task type abstraction for complex workflows
- Configure proper logging levels for troubleshooting
Conclusion
This guide demonstrates that Apache DolphinScheduler 3.2.0 successfully passes all functional, compatibility, and security tests in a single-node deployment scenario. The platform continues to evolve as a robust solution for modern data orchestration needs, offering:
- Intuitive workflow management
- Extensive task type support
- Scalable architecture
- Enterprise-grade scheduling capabilities
For production deployments, monitor the community for stability updates or consider version 3.1.9 while 3.2.0 undergoes further production validation.
Leave a Reply