The Composable Platform Deployment Suite

Ansible/Docker/Kubernetes Environment (ADK) – Simplifying cluster environments, minimizing maintenance, and enabling smooth upgrades is critical to analytics and IoT clusters. Finding professionals to manage these clusters is difficult and keeping these engineers trained on the latest updates is an issue. This is particularly hard when running multiple applications on a cluster which may interact and require specific security implementations. Paladian has developed the ADK environment to make deploying and managing these platforms as simple as specifying the requirements in a unified spreadsheet format and linking to the custom configuration features of choice. Updating the environments is as simple as modifying parameters in the configuration files and running an update ADK script, to orchestrate a simultaneous update for all the relevant applications in the preferred order.

The Paladian SureConnect™ software  ensures your data is collected securely by tracking the robustness of  the cluster fabric and the health of its Ethernet and PCIe connections.  During routine maintenance in a data center, cabling can be damaged.  SureConnect™ periodically checks that the connections are operating  properly within the transmission guidelines. If SureConnect™ determines a  link has errors or a high rate of re-transmissions it will automatically  transfer the connection to a backup path and notify the administrator.  In large clusters the application software may cause a server to go down  or disconnect. The cluster servers typically manage their own data. It  can be time consuming to reconnect to the data or recreate stale data  once a server is restarted. In case of large drives this can take  several days before the system is stable again. SureConnect™ allows this  storage to be reassigned automatically to another hot server so that  there is no noticeable effect on the cluster’s operation and risk of  additional errors causing a total application shutdown.

The Paladian Watchman™ software monitors your IoT data flows to ensure normal measurements or events and that your sources continue to operate within requested performance parameters. This module uses machine learning routines to establish baselines, tracks that periodic measurements or events are returned regularly, verifies that the data is within bounds using the established baselines, highlights any anomalies, and determines if that the data is trending towards an excursion – results that often are difficult to observe when running routine dashboards or reports. The Paladian machine learning routines (Watchman™) provide streaming analysis, data consolidation/deduplication and monitoring.

Many companies keep up to 90 days of hot/warm data on-premises due to response times or bandwidth concerns. However, to minimize long-term support infrastructure, longer-term data may be moved to either a local or external cloud object store, like Amazon’s S3. As a compromise some parts of longer-term data can also be kept locally by using a local cache and just keeping additional copies in the cloud for reliability. The HSM (Hybrid Storage Manager) enables customers to easily set up a hybrid storage environment using custom specific requirements. Once HSM establishes an environment, customers can access their data as needed, monitor performance and cost parameters, and fine tune the settings to optimize the performance to the use models.