Begin with the environment description
The case starts with a description of the supply network and a replenishment objective. The first simulator and policy are developed from this starting point.
Provided input
Initial environment description
A factory supplies six stores through two warehouses. The description specifies initial stock, lead times, demand variability and holding/backlog costs.
Provided task
Choose a replenishment policy
Design retailer and warehouse order rules to minimize total holding and backlog cost over a 100-day episode.
Read the initial environment specification
NETWORK AND INITIAL STATE
Factory → warehouse A → stores 0–2; Factory → warehouse B → stores 3–5.
Each warehouse starts with 800 units; each store starts with 100. Factory supply is unlimited.
Factory-to-warehouse lead time: 4 days. Warehouse-to-store lead time: 2 days.
DEMAND AND COST
Every store: max(0, 25 + Uniform(−8, 8) + 5 sin(2π day / 14)).
Store holding/backlog costs: 3 / 120 per unit per day.
Warehouse holding/backlog costs: 0.8 / 40. Unsatisfied demand is backlogged.
Costs accrue at day end; no terminal salvage value.
POLICY INTERFACE
period is 1-based; inventory_dict = {1: inventory_position}.
Inventory position = on-hand + all outstanding replenishment orders − backlog.
Policies return a nonnegative quantity through POLICY_MOUNTS.
Evaluation episodes start from the stated initial stock, with zero backlog/pipeline.