DataMagic Technical Column Vol.6
(Extra Edition) HULFT-HUB + DataMagic Integration Case Study
Introduction
This time, we will introduce a real case study that utilizes the tips from DataMagic technical columns we have introduced so far. This is a case study of a financial company that implemented a combination of DataMagic and related HULFT products, resulting in significant improvements in operational efficiency in data integration.
background
In the financial industry, administrative systems that streamline administrative procedures at branches and administrative centers play a very important role. Financial company A previously imported account information required for administrative procedures from a core system host and processed it in its administrative system. However, the increase in business volume and data volume led to an increase in the number of servers on the administrative system side, and security measures required for handling customer account information, making the operation and management of the entire system a heavy burden, so the company decided to restructure its relay system to strengthen it.
Existing system configuration
Initially, the system configuration was small and limited, with around five servers on the administrative system side data integration between the core host and HULFT. Furthermore, security of the core host was given top priority, and the system was constructed with the following interface policy in mind:
Interface Policy
- HULFT, which has extensive encryption and history management functions, is used as standard for data integration
- Build an IF server that acts as a relay system and prohibit direct data integration with the host.
- Limit the tasks that involve data integration with the core host and access only the minimum necessary servers
After a few years, the amount of work and data increased more than initially expected, and the number of servers on the administrative system side ballooned to more than 50. As a result, various issues began to arise.
Issues with the existing system
In the existing system, as the number of servers on the administrative system side increased, the entire system became more complex, and there were many issues in operation and management, such as transfer settings, checking transfer logs, master synchronization, etc. In order to ensure absolute security, many sacrifices had to be made, and the system was unable to keep up with the increasing volume of work and data.
assignment
- Multiple forwarding settings are required for one business process (e.g., you want to send from A to D, but you need to set up each forwarding setting for A → B → C → D)
- When a problem occurs, it is necessary to check the transfer logs of multiple related locations (transfer logs A, B, C, and D must be checked).
- The code conversion master is scattered across the host and various administrative systems (50 locations), making it difficult to synchronize the master.
Solutions using "HULFT-HUB" and "DataMagic"
By introducing HULFT-HUB and DataMagic to the IF server, which serves as the relay system, the issues with the existing system were resolved.
The key to solving the problem is the following three points.
Solution point
- HULFT-HUB 's automatic routing function eliminates the need for multiple forwarding settings for a single business process.
- HULFT-HUB 's integrated history management function allows you to manage all HULFT transfer logs in one place.
- By utilizing DataMagic 's code conversion function, the scattered code conversion work was consolidated into one place.
- DataMagic Technical Column Vol.1 (Character Code Conversion: EBCDIC⇔Shift_JIS Edition)
- DataMagic Technical Column Vol.2 (Character Code Conversion: External Character Code Edition)
summary
By combining HULFT-HUB and DataMagic, we have achieved both security and efficiency by ensuring absolute security and enabling smart operations.
Benefits of implementation
This time, we introduced a case study of integration using the combination of HULFT-HUB and DataMagic. Please download the trial versions of HULFT-HUB and DataMagic and try out the explanations in this technical column.
- Reduce operational management workload by 70%
- HULFT-HUB 's automatic routing function enables secure transfer routes and significantly reduces the amount of work required for transfer settings.
- Reduced troubleshooting time
- HULFT-HUB 's integrated management function enables management of all transfer logs from one location.
- Consolidation of masters scattered across 50 locations
- By consolidating the code conversion master in one place on the IF server, the hassle of master synchronization is no longer necessary.
- The trial version is free to use for 60 days.
- After you sign up for the trial version, you will receive 90 days of free technical support.
DataMagic Column List
- DataMagic Manager Installation
- "DataMagic" is recommended for its "fast, cheap, and easy" features.
- Vol.1 Character code conversion: EBCDIC⇔Shift_JIS
- Vol.2 Character Code Conversion: External Character Codes
- Vol.3 Character Code Conversion: Unicode (UTF-8)
- Vol.4 Data Conversion: Pack⇔Zone Edition
- Vol.5 (Fixed length ⇒ CSV data conversion)
- Vol.6 (Special Edition) HUB+ DataMagic Collaboration Case Study
- Vol.7 <Distribution BMS ⇒ CSV Conversion>
- Vol.8 <Matching Processing>
- Vol.9 (Full-width⇔Half-width Conversion)
- Vol.10 (DB table data extraction)
- Vol.11 Data Correction
- Vol.12 〈String Replacement〉
- Vol.13 (Special Edition) DataMagic Implementation Case Studies
- Vol.14 (Data sorting and file division)
- Vol.15 Data Collection
- Vol.16 File Merging
- Vol.17 HULFT Definition Bulk Registration
- Vol.18 (Special Edition) HULFT-WebFiletransfer + DataMagic Integration Case Study
- Vol.19 (Introduction Case Studies) Our company's use cases
- Vol.20 Data Masking
- Vol.21 (DB Migration Edition)
- Vol.22 <Common Components: EBCDIC Code Replacement>
- Vol.22 Appendix <Common Component Import and Execution Procedures>
- Vol.23 <Common Components: Date Conversion Function Extension>
- Vol.24 〈Resolving customer requests!: Common components that can process data even if there is invalid data〉