Patent application number | Description | Published |
20150143380 | SCHEDULING WORKLOADS AND MAKING PROVISION DECISIONS OF COMPUTER RESOURCES IN A COMPUTING ENVIRONMENT - Embodiments of the present invention disclose a computer-implemented method, computer program product, and system for workload scheduling and resource provisioning. In one embodiment, in accordance with the present invention, the computer implemented method includes the steps of scheduling a set of pending workloads for execution on computer resources in a computing environment; identifying a workload in the set of pending workloads that is scheduled to utilize hypothetic resources, wherein hypothetic resources are idle computer resources that are currently not available, but can be made available to execute workloads through provisioning actions; holding the identified workload from dispatch to hypothetic resources for a holding period, wherein the holding period is a customizable duration of time; provisioning the hypothetic resources corresponding to computer resource requirements of the identified workload; determining whether the provisioned hypothetic resources have become available during the holding period. | 05-21-2015 |
20150143381 | COMPUTING SESSION WORKLOAD SCHEDULING AND MANAGEMENT OF PARENT-CHILD TASKS - A single workload scheduler schedules sessions and tasks having a tree structure to resources, wherein the single workload scheduler has scheduling control of the resources and the tasks of the parent-child workload sessions and tasks. The single workload scheduler receives a request to schedule a child session created by a scheduled parent task that when executed results in a child task; the scheduled parent task is dependent on a result of the child task. The single workload scheduler receives a message from the scheduled parent task yielding a resource based on the resource not being used by the scheduled parent task, schedules tasks to backfill the resource, and returns the resource yielded by the scheduled parent task to the scheduled parent task based on receiving a resume request from the scheduled parent task or determining dependencies of the scheduled parent task have been met. | 05-21-2015 |
20150150017 | OPTIMIZATION OF MAP-REDUCE SHUFFLE PERFORMANCE THROUGH SHUFFLER I/O PIPELINE ACTIONS AND PLANNING - A shuffler receives information associated with partition segments of map task outputs and a pipeline policy for a job running on a computing device. The shuffler transmits to an operating system of the computing device a request to lock partition segments of the map task outputs and transmits an advisement to keep or load partition segments of map task outputs in the memory of the computing device. The shuffler creates a pipeline based on the pipeline policy, wherein the pipeline includes partition segments locked in the memory and partition segments advised to keep or load in the memory, of the computing device for the job, and the shuffler selects the partition segments locked in the memory, followed by partition segments advised to keep or load in the memory, as a preferential order of partition segments to shuffle. | 05-28-2015 |
20150150018 | OPTIMIZATION OF MAP-REDUCE SHUFFLE PERFORMANCE THROUGH SHUFFLER I/O PIPELINE ACTIONS AND PLANNING - A shuffler receives information associated with partition segments of map task outputs and a pipeline policy for a job running on a computing device. The shuffler transmits to an operating system of the computing device a request to lock partition segments of the map task outputs and transmits an advisement to keep or load partition segments of map task outputs in the memory of the computing device. The shuffler creates a pipeline based on the pipeline policy, wherein the pipeline includes partition segments locked in the memory and partition segments advised to keep or load in the memory, of the computing device for the job, and the shuffler selects the partition segments locked in the memory, followed by partition segments advised to keep or load in the memory, as a preferential order of partition segments to shuffle. | 05-28-2015 |
20150227389 | INTERLEAVE-SCHEDULING OF CORRELATED TASKS AND BACKFILL-SCHEDULING OF DEPENDER TASKS INTO A SLOT OF DEPENDEE TASKS - Methods and arrangements for assembling tasks in a progressive queue. At least one job is received, each job comprising a dependee set of tasks and a depender set of at least one task. The dependee tasks are assembled in a progressive queue for execution, and the dependee tasks are executed. Other variants and embodiments are broadly contemplated herein. | 08-13-2015 |
20150227394 | DETECTION OF TIME POINTS TO VOLUNTARILY YIELD RESOURCES FOR CONTEXT SWITCHING - Methods and arrangements for yielding resources in data processing. At least one job is received, each job comprising a dependee set of tasks and a depender set of at least one task, and the at least one of the dependee set of tasks is executed. At least one resource of the at least one of the dependee set of tasks is yielded upon detection of resource underutilization in at least one other location. Other variants and embodiments are broadly contemplated herein. Other variants and embodiments are broadly contemplated herein. | 08-13-2015 |
20150227399 | MANAGING DATA SEGMENTS IN MEMORY FOR CONTEXT SWITCHING WITH STANDALONE FETCH AND MERGE SERVICES - Methods and arrangements for managing data segments. At least one job is received, each job comprising a dependee set of tasks and a depender set of at least one task, and the at least one of the dependee set of tasks is executed. There is extracted, from the at least one of the dependee set of tasks, at least one service common to at least another of the dependee set of tasks. Other variants and embodiments are broadly contemplated herein. | 08-13-2015 |
20160062795 | MULTI-LAYER QOS MANAGEMENT IN A DISTRIBUTED COMPUTING ENVIRONMENT - A technique for multi-layer quality of service (QoS) management in a distributed computing environment includes: receiving a workload to run in a distributed computing environment; identifying a workload quality of service (QoS) class for the workload; translating the workload QoS class to a storage level QoS class; scheduling the workload to run on a compute node of the environment; communicating the storage level QoS class to a workload execution manager of the compute node; communicating the storage level QoS class to one or more storage managers of the environment, the storage managers managing storage resources in the environment; and extending, by the storage managers, the storage level QoS class to the storage resources to support the workload QoS class. | 03-03-2016 |
20160065492 | MULTI-LAYER QOS MANAGEMENT IN A DISTRIBUTED COMPUTING ENVIRONMENT - A system for multi-layer quality of service (QoS) management in a distributed computing environment includes: a management node hosting a workload scheduler operable to receive a workload and identify a workload QoS class for the workload; and a plurality of distributed compute nodes, the workload scheduler operable to schedule running of the workload on the compute nodes. The workload scheduler is operable to: translate the workload QoS class to a storage level QoS class; communicate the storage level QoS class to a workload execution manager of the compute nodes; and communicate the storage level QoS class to one or more storage managers, the storage managers managing storage resources. The storage managers are operable to extend the storage level QoS class to the storage resources to support the workload QoS class. | 03-03-2016 |