-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Summary
Users would like to be able to specify custom resource requirements on Component objects. These can be passed to Ray when a RayProcess is used or a Tuner object is run.
Requirements:
- Must be able to specify
Resourcerequirements forcpu,gpu,memory,resources. These should be defined as a Pydantic class inplugboard_schemas. - Must be able to specify resources as a numerical value, or as a string (to be validated by Pydantic), e.g.
250mfor 0.25 or10Mifor 1024 * 1024 * 10.resourcesshould be a dictionary of string key, numerical value pairs. - Must be able to convert these requirements to their Ray equivalents, see https://docs.ray.io/en/latest/ray-core/api/doc/ray.actor.ActorClass.options.html, i.e.
cpu = "250m"gets converted tonum_cpus=0.25. - Must be able to pass a
Resourceto aComponentwhen instantiating it. This will require changes to theComponentand its schema, so that we can specify resource requirements in YAML config. - The default requirement should be
{"cpu": 0.001}, to be used if the user does not provide anything. - Resource requirements should be passed to the actor options in
RayProcess. - They should be used in the resource placement group inside
Tuner.
Example
No response
Alternatives
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request