diff --git a/sdks/graphql/manage-pods.mdx b/sdks/graphql/manage-pods.mdx index 6c17b38b..fad19449 100644 --- a/sdks/graphql/manage-pods.mdx +++ b/sdks/graphql/manage-pods.mdx @@ -22,6 +22,8 @@ For the complete schema, see the [GraphQL Spec](https://graphql-spec.runpod.io/) Pods provide guaranteed compute at a fixed price. +The `podFindAndDeployOnDemand` mutation searches for an available machine that matches your input, then deploys a Pod on it. Fields prefixed with `min` (such as `minVcpuCount` and `minMemoryInGb`) set minimum requirements that a machine must meet. They don't set fixed allocations. The vCPU and memory your Pod receives depend on the machine Runpod selects. + ```bash diff --git a/serverless/endpoints/endpoint-configurations.mdx b/serverless/endpoints/endpoint-configurations.mdx index 540cd6b0..b837dca5 100644 --- a/serverless/endpoints/endpoint-configurations.mdx +++ b/serverless/endpoints/endpoint-configurations.mdx @@ -71,6 +71,8 @@ Number of GPUs assigned to each worker instance. Default is 1. Generally priorit **Request count**: More aggressive scaling based on pending + active work. Formula: `Math.ceil((requestsInQueue + requestsInProgress) / scalerValue)`. Use scaler value of 1 for max responsiveness. Recommended for LLM workloads or frequent short requests. +For both scaling types, the scaler value must be a whole number of 1 or greater (default: 4). Fractional values like 0.5 are not accepted. + ## Lifecycle and timeouts ### Idle timeout