build checks.x86_64-linux.pytest

Reproduce this run
  1. 0.15 s $ /nix/store/9ypz3flqsrl5xl495mm8h645gadjsxi1-coreutils-9.11/bin/timeout --kill-after=15s 7200s /nix/store/23zk8sgzamrbmj1fday15szf7f2279s8-nix-2.34.7/bin/nix --extra-experimental-features nix-command --extra-experimental-features flakes --log-format internal-json build --no-link --print-out-paths git+https://github.com/NorfairKing/dspy?ref=your-first-flake&rev=453ecf257a343742170b3e1cef20271508c3e6a4#checks.x86_64-linux.pytest --print-build-logs
  2. 0.17 s
  3. 0.58 s Building /nix/store/rcq49d990xqb45ygc83sng306xk2cspr-dspy-pytest.drv
  4. 0.61 s [dspy-pytest] Phase: unpackPhase
  5. 0.61 s [dspy-pytest] unpacking source archive /nix/store/65n02b36yl4dm50hw7nc4inq18zbw5rm-r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source
  6. 0.66 s [dspy-pytest] source root is r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source
  7. 0.67 s [dspy-pytest] Phase: patchPhase
  8. 0.67 s [dspy-pytest] Phase: updateAutotoolsGnuConfigScriptsPhase
  9. 0.68 s [dspy-pytest] Phase: checkPhase
  10. 3.17 s [dspy-pytest] ============================= test session starts ==============================
  11. 3.17 s [dspy-pytest] platform linux -- Python 3.13.13, pytest-8.4.2, pluggy-1.6.0 -- /nix/store/rn0r480kscbk8159qi3qjflil71kqglq-dspy-test-env/bin/python3.13
  12. 3.19 s [dspy-pytest] rootdir: /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source
  13. 3.19 s [dspy-pytest] configfile: pyproject.toml
  14. 3.19 s [dspy-pytest] plugins: anyio-4.13.0, asyncio-1.3.0, typeguard-4.5.1, mock-3.14.1
  15. 3.19 s [dspy-pytest] asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function
  16. 7.45 s [dspy-pytest] collected 1322 items / 9 deselected / 1 skipped / 1313 selected
  17. 7.47 s [dspy-pytest]
  18. 9.07 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_str_annotation PASSED [ 0%]
  19. 10.66 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_pydantic_types PASSED [ 0%]
  20. 12.51 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_basic_types PASSED [ 0%]
  21. 13.76 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_literal PASSED [ 0%]
  22. 14.90 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_union PASSED [ 0%]
  23. 16.03 s [dspy-pytest] tests/adapters/test_adapter_utils.py::test_parse_value_json_repair PASSED [ 0%]
  24. 18.59 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[wav-wav] PASSED [ 0%]
  25. 21.56 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[mp3-mp3] PASSED [ 0%]
  26. 23.68 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[x-wav-wav] PASSED [ 0%]
  27. 25.89 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[x-mp3-mp3] PASSED [ 0%]
  28. 29.04 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[x-flac-flac] PASSED [ 0%]
  29. 31.36 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[my-x-format-my-x-format] PASSED [ 0%]
  30. 33.77 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[x-my-format-my-format] PASSED [ 0%]
  31. 35.80 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[-] PASSED [ 1%]
  32. 38.02 s [dspy-pytest] tests/adapters/test_audio.py::test_normalize_audio_format[x--] PASSED [ 1%]
  33. 40.33 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_format_exact_messages_for_simple_signature_with_demo PASSED [ 1%]
  34. 42.97 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_format_exact_messages_with_nested_output PASSED [ 1%]
  35. 45.15 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_basic_schema_generation PASSED [ 1%]
  36. 47.34 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_optional_fields PASSED [ 1%]
  37. 49.72 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_primitive_types PASSED [ 1%]
  38. 52.11 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_lists_with_bracket_notation PASSED [ 1%]
  39. 54.44 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_complex_nested_models PASSED [ 1%]
  40. 56.73 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_raise_error_on_circular_references PASSED [ 1%]
  41. 59.20 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_formats_pydantic_inputs_as_clean_json PASSED [ 1%]
  42. 61.52 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_mixed_input_types PASSED [ 1%]
  43. 63.92 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_schema_generation_errors_gracefully PASSED [ 1%]
  44. 66.18 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_raises_on_missing_fields PASSED [ 2%]
  45. 67.95 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_handles_type_casting_errors PASSED [ 2%]
  46. 69.88 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_with_images PASSED [ 2%]
  47. 71.86 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_with_tools PASSED [ 2%]
  48. 73.88 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_with_code PASSED [ 2%]
  49. 75.87 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_with_conversation_history PASSED [ 2%]
  50. 78.07 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_vs_json_adapter_token_efficiency PASSED [ 2%]
  51. 80.19 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_vs_json_adapter_functional_compatibility PASSED [ 2%]
  52. 82.47 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_async_functionality PASSED [ 2%]
  53. 84.86 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_with_field_aliases PASSED [ 2%]
  54. 87.29 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_field_alias_without_description PASSED [ 2%]
  55. 90.23 s [dspy-pytest] tests/adapters/test_baml_adapter.py::test_baml_adapter_multiple_pydantic_input_fields PASSED [ 2%]
  56. 93.00 s [dspy-pytest] tests/adapters/test_base_type.py::test_basic_extract_custom_type_from_annotation PASSED [ 2%]
  57. 95.95 s [dspy-pytest] tests/adapters/test_base_type.py::test_extract_custom_type_from_annotation_with_nested_type PASSED [ 3%]
  58. 98.88 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_quotes_literals_as_expected[Literal-Literal-two-Literal['one', 'two', 'three"']-Literal['four', 'five', 'six"']] PASSED [ 3%]
  59. 101.62 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_quotes_literals_as_expected[Literal-Literal-she's here-Literal["she's here", 'okay', 'test']-Literal['done', "maybe'soon", 'later']] PASSED [ 3%]
  60. 104.60 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_quotes_literals_as_expected[Literal-Literal-another-Literal['both"and\\'', 'another']-Literal['yet"another\\'', 'plain']] PASSED [ 3%]
  61. 107.87 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_quotes_literals_as_expected[Literal-Literal-foo-Literal['foo', 'bar']-Literal['baz', 'qux']] PASSED [ 3%]
  62. 109.91 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_quotes_literals_as_expected[Literal-Literal-bar-Literal[1, 'bar']-Literal[True, 3, 'foo']] PASSED [ 3%]
  63. 111.88 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_sync_call PASSED [ 3%]
  64. 113.62 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_async_call PASSED [ 3%]
  65. 115.15 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_for_simple_signature PASSED [ 3%]
  66. 117.04 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_demo_and_typed_outputs PASSED [ 3%]
  67. 118.93 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_nested_pydantic_models PASSED [ 3%]
  68. 120.97 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_incomplete_demo PASSED [ 3%]
  69. 123.07 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_history PASSED [ 3%]
  70. 125.04 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_list_value_for_string_input PASSED [ 4%]
  71. 127.12 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_literal_output PASSED [ 4%]
  72. 128.97 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_multimodal_custom_type_inputs PASSED [ 4%]
  73. 130.70 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_history_demo_pydantic_tools_and_image PASSED [ 4%]
  74. 132.73 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_base_custom_type_input PASSED [ 4%]
  75. 134.40 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_citations_output_demo PASSED [ 4%]
  76. 136.48 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_and_lm_kwargs_with_native_citations PASSED [ 4%]
  77. 138.70 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_preserves_passthrough_lm_kwargs PASSED [ 4%]
  78. 141.48 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_and_lm_kwargs_with_native_reasoning PASSED [ 4%]
  79. 144.33 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_calling_still_enables_native_reasoning PASSED [ 4%]
  80. 147.08 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_nonnative_strips_native_tool_kwargs PASSED [ 4%]
  81. 149.71 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_reasoning_and_code_outputs PASSED [ 4%]
  82. 152.44 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_and_lm_kwargs_with_native_tool_calling PASSED [ 4%]
  83. 155.27 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_adapter_native_tool_calling_can_request_parallel_tool_calls[adapter0] PASSED [ 5%]
  84. 158.64 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_adapter_native_tool_calling_can_request_parallel_tool_calls[adapter1] PASSED [ 5%]
  85. 161.35 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_adapter_native_tool_calling_can_request_parallel_tool_calls[adapter2] PASSED [ 5%]
  86. 163.31 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_adapter_native_tool_calling_respects_lm_kwargs_parallel_tool_call_override PASSED [ 5%]
  87. 165.30 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_replay PASSED [ 5%]
  88. 167.12 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_replays_parallel_tool_results PASSED [ 5%]
  89. 168.85 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_skips_empty_user_message PASSED [ 5%]
  90. 170.77 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_skips_unmatched_tool_calls[call_1-None] PASSED [ 5%]
  91. 172.66 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_skips_unmatched_tool_calls[call_1-tool_call_results1] PASSED [ 5%]
  92. 174.70 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_tool_history_skips_unmatched_tool_calls[None-tool_call_results2] PASSED [ 5%]
  93. 176.78 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_non_native_tool_history PASSED [ 5%]
  94. 178.73 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_non_native_tool_history_remains_text_based[adapter0] PASSED [ 5%]
  95. 180.43 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_non_native_tool_history_remains_text_based[adapter1] PASSED [ 5%]
  96. 181.67 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_accepts_custom_history_formatter_returning_messages_only PASSED [ 6%]
  97. 182.87 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_with_tool_input PASSED [ 6%]
  98. 184.14 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_format_exact_messages_kitchen_sink PASSED [ 6%]
  99. 185.43 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_with_pydantic_models PASSED [ 6%]
  100. 187.01 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_signature_information PASSED [ 6%]
  101. 188.70 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_exception_raised_on_failure PASSED [ 6%]
  102. 190.51 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_formats_image PASSED [ 6%]
  103. 191.79 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_formats_image_with_few_shot_examples PASSED [ 6%]
  104. 193.12 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_formats_image_with_nested_images PASSED [ 6%]
  105. 194.82 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_formats_image_with_few_shot_examples_with_nested_images PASSED [ 6%]
  106. 196.67 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_with_tool PASSED [ 6%]
  107. 198.49 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_with_code PASSED [ 6%]
  108. 200.94 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_code_output_field_omits_json_schema_in_prompt PASSED [ 6%]
  109. 203.47 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_citations_output_field_keeps_json_schema_in_prompt PASSED [ 7%]
  110. 206.35 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_formats_conversation_history PASSED [ 7%]
  111. 209.12 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_fallback_to_json_adapter_on_exception PASSED [ 7%]
  112. 212.02 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_fallback_preserves_native_function_calling_flag PASSED [ 7%]
  113. 214.77 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_respects_use_json_adapter_fallback_flag PASSED [ 7%]
  114. 218.26 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_fallback_to_json_adapter_on_exception_async PASSED [ 7%]
  115. 221.58 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_async_fallback_preserves_native_function_calling_flag PASSED [ 7%]
  116. 223.92 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_toolcalls_native_function_calling PASSED [ 7%]
  117. 225.61 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_toolcalls_vague_match PASSED [ 7%]
  118. 227.15 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_native_reasoning PASSED [ 7%]
  119. 228.46 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_chat_adapter_parses_float_with_underscores PASSED [ 7%]
  120. 229.80 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_format_system_message PASSED [ 7%]
  121. 231.15 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_null_content_raises_adapter_parse_error PASSED [ 7%]
  122. 232.90 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_empty_string_content_raises_adapter_parse_error PASSED [ 7%]
  123. 234.89 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_tool_call_with_null_content_does_not_raise PASSED [ 8%]
  124. 236.91 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_tool_call_with_unstructured_content_does_not_raise PASSED [ 8%]
  125. 238.84 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_tool_call_with_structured_content_preserves_other_outputs PASSED [ 8%]
  126. 240.81 s [dspy-pytest] tests/adapters/test_chat_adapter.py::test_provider_tool_calls_preserve_id_and_repair_arguments PASSED [ 8%]
  127. 242.85 s [dspy-pytest] tests/adapters/test_citation.py::test_citation_validate_input PASSED [ 8%]
  128. 244.85 s [dspy-pytest] tests/adapters/test_citation.py::test_citations_in_nested_type PASSED [ 8%]
  129. 246.89 s [dspy-pytest] tests/adapters/test_citation.py::test_citation_with_all_fields PASSED [ 8%]
  130. 248.68 s [dspy-pytest] tests/adapters/test_citation.py::test_citation_format PASSED [ 8%]
  131. 250.63 s [dspy-pytest] tests/adapters/test_citation.py::test_citations_format PASSED [ 8%]
  132. 252.51 s [dspy-pytest] tests/adapters/test_citation.py::test_citations_from_dict_list PASSED [ 8%]
  133. 254.48 s [dspy-pytest] tests/adapters/test_citation.py::test_citations_postprocessing PASSED [ 8%]
  134. 256.62 s [dspy-pytest] tests/adapters/test_citation.py::test_citation_extraction_from_lm_response PASSED [ 8%]
  135. 258.71 s [dspy-pytest] tests/adapters/test_code.py::test_code_validate_input PASSED [ 8%]
  136. 260.48 s [dspy-pytest] tests/adapters/test_code.py::test_code_in_nested_type PASSED [ 9%]
  137. 262.40 s [dspy-pytest] tests/adapters/test_code.py::test_code_with_language PASSED [ 9%]
  138. 264.34 s [dspy-pytest] tests/adapters/test_code.py::test_code_parses_from_dirty_code PASSED [ 9%]
  139. 266.51 s [dspy-pytest] tests/adapters/test_document.py::test_document_validate_input PASSED [ 9%]
  140. 268.42 s [dspy-pytest] tests/adapters/test_document.py::test_document_in_nested_type PASSED [ 9%]
  141. 270.41 s [dspy-pytest] tests/adapters/test_document.py::test_document_with_all_fields PASSED [ 9%]
  142. 272.65 s [dspy-pytest] tests/adapters/test_document.py::test_document_format PASSED [ 9%]
  143. 274.85 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_for_simple_signature PASSED [ 9%]
  144. 276.66 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_demo_and_typed_output PASSED [ 9%]
  145. 278.44 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_described_and_bool_outputs PASSED [ 9%]
  146. 280.41 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_history_demo_pydantic_tools_and_image PASSED [ 9%]
  147. 282.14 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_int_and_mapping_outputs PASSED [ 9%]
  148. 284.01 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_literal_and_enum_outputs PASSED [ 9%]
  149. 286.30 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_nested_pydantic_output PASSED [ 10%]
  150. 288.10 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_incomplete_demo PASSED [ 10%]
  151. 289.89 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_and_lm_kwargs_with_native_tool_calling PASSED [ 10%]
  152. 291.65 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_messages_with_tool_calls_output_demo PASSED [ 10%]
  153. 293.69 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_format_exact_non_native_tool_result_history_field PASSED [ 10%]
  154. 295.58 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_passes_structured_output_when_supported_by_model PASSED [ 10%]
  155. 297.34 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_not_using_structured_outputs_when_not_supported_by_model PASSED [ 10%]
  156. 299.04 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_with_structured_outputs_does_not_mutate_original_signature PASSED [ 10%]
  157. 300.97 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_sync_call PASSED [ 10%]
  158. 302.73 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_async_call PASSED [ 10%]
  159. 304.52 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_on_pydantic_model PASSED [ 10%]
  160. 306.31 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_parse_raise_error_on_mismatch_fields PASSED [ 10%]
  161. 308.36 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_image PASSED [ 10%]
  162. 310.76 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_image_with_few_shot_examples PASSED [ 11%]
  163. 313.35 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_image_with_nested_images PASSED [ 11%]
  164. 316.08 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_with_nested_documents PASSED [ 11%]
  165. 318.64 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_image_with_few_shot_examples_with_nested_images PASSED [ 11%]
  166. 321.11 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_with_tool PASSED [ 11%]
  167. 323.56 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_with_code PASSED [ 11%]
  168. 325.81 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_formats_conversation_history PASSED [ 11%]
  169. 328.15 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_on_pydantic_model_async PASSED [ 11%]
  170. 330.43 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_does_not_fallback_to_json_mode_on_structured_output_lm_error PASSED [ 11%]
  171. 332.18 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_json_mode_no_structured_outputs PASSED [ 11%]
  172. 333.89 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_json_mode_no_structured_outputs_async PASSED [ 11%]
  173. 335.74 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_does_not_fallback_to_json_mode_on_structured_output_lm_error_async PASSED [ 11%]
  174. 337.47 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_error_message_on_json_adapter_failure PASSED [ 11%]
  175. 339.15 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_error_message_on_json_adapter_failure_async PASSED [ 12%]
  176. 340.92 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_toolcalls_native_function_calling PASSED [ 12%]
  177. 342.79 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_toolcalls_no_native_function_calling PASSED [ 12%]
  178. 344.47 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_native_reasoning PASSED [ 12%]
  179. 346.13 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_json_adapter_with_responses_api PASSED [ 12%]
  180. 347.84 s [dspy-pytest] tests/adapters/test_json_adapter.py::test_format_system_message PASSED [ 12%]
  181. 349.63 s [dspy-pytest] tests/adapters/test_reasoning.py::test_reasoning_basic_operations PASSED [ 12%]
  182. 351.32 s [dspy-pytest] tests/adapters/test_reasoning.py::test_reasoning_concatenation PASSED [ 12%]
  183. 353.08 s [dspy-pytest] tests/adapters/test_reasoning.py::test_reasoning_string_methods PASSED [ 12%]
  184. 354.96 s [dspy-pytest] tests/adapters/test_reasoning.py::test_reasoning_with_chain_of_thought PASSED [ 12%]
  185. 356.68 s [dspy-pytest] tests/adapters/test_reasoning.py::test_reasoning_error_message PASSED [ 12%]
  186. 358.38 s [dspy-pytest] tests/adapters/test_tool.py::test_basic_initialization PASSED [ 12%]
  187. 360.08 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_from_function PASSED [ 12%]
  188. 361.95 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_from_class PASSED [ 13%]
  189. 363.67 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_from_function_with_pydantic PASSED [ 13%]
  190. 365.33 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_from_function_with_pydantic_nesting PASSED [ 13%]
  191. 367.02 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_callable PASSED [ 13%]
  192. 368.66 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_with_pydantic_callable PASSED [ 13%]
  193. 370.41 s [dspy-pytest] tests/adapters/test_tool.py::test_invalid_function_call PASSED [ 13%]
  194. 372.12 s [dspy-pytest] tests/adapters/test_tool.py::test_parameter_desc PASSED [ 13%]
  195. 373.83 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_with_default_args_without_type_hints PASSED [ 13%]
  196. 375.57 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_parses_args PASSED [ 13%]
  197. 377.40 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_parses_nested_list_of_pydantic_model PASSED [ 13%]
  198. 379.12 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_kwarg PASSED [ 13%]
  199. 380.79 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_str PASSED [ 13%]
  200. 382.61 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_from_function PASSED [ 13%]
  201. 384.51 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_with_pydantic PASSED [ 14%]
  202. 386.44 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_with_complex_pydantic PASSED [ 14%]
  203. 388.04 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_invalid_call PASSED [ 14%]
  204. 389.84 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_with_kwargs PASSED [ 14%]
  205. 391.61 s [dspy-pytest] tests/adapters/test_tool.py::test_async_concurrent_calls PASSED [ 14%]
  206. 393.43 s [dspy-pytest] tests/adapters/test_tool.py::test_async_tool_call_in_sync_mode PASSED [ 14%]
  207. 395.14 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_format_basic[tool_calls_data0-expected0] PASSED [ 14%]
  208. 396.93 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_format_basic[tool_calls_data1-expected1] PASSED [ 14%]
  209. 398.66 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_format_basic[tool_calls_data2-expected2] PASSED [ 14%]
  210. 400.37 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_format_basic[tool_calls_data3-expected3] PASSED [ 14%]
  211. 402.20 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_format_from_dict_list PASSED [ 14%]
  212. 404.06 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_preserves_ids_from_dict_list_and_format_omits_ids PASSED [ 14%]
  213. 405.74 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_json_schema_omits_internal_id_field PASSED [ 14%]
  214. 407.42 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_calls_can_carry_results_without_formatting_them_for_lm PASSED [ 15%]
  215. 409.16 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_results_from_tool_calls_and_values PASSED [ 15%]
  216. 410.95 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_results_history_serialization_round_trip PASSED [ 15%]
  217. 412.67 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_results_can_round_trip_as_native_tool_result_message PASSED [ 15%]
  218. 414.37 s [dspy-pytest] tests/adapters/test_tool.py::test_toolcalls_vague_match PASSED [ 15%]
  219. 416.06 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_convert_input_schema_to_tool_args_no_input_params PASSED [ 15%]
  220. 417.88 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_convert_input_schema_to_tool_args_lang_chain PASSED [ 15%]
  221. 419.66 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_execute PASSED [ 15%]
  222. 421.41 s [dspy-pytest] tests/adapters/test_tool.py::test_tool_call_execute_with_local_functions PASSED [ 15%]
  223. 423.07 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_format_exact_messages_for_simple_signature_with_demo PASSED [ 15%]
  224. 424.80 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_format_exact_messages_with_typed_outputs PASSED [ 15%]
  225. 426.62 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_call PASSED [ 15%]
  226. 428.87 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_async_call PASSED [ 15%]
  227. 431.30 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_parse PASSED [ 15%]
  228. 433.79 s [dspy-pytest] tests/adapters/test_two_step_adapter.py::test_two_step_adapter_parse_errors PASSED [ 16%]
  229. 436.21 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_and_parse_basic PASSED [ 16%]
  230. 438.62 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_parse_multiple_fields PASSED [ 16%]
  231. 441.09 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_parse_raises_on_missing_field PASSED [ 16%]
  232. 443.54 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_parse_casts_types PASSED [ 16%]
  233. 445.90 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_parse_raises_on_type_error PASSED [ 16%]
  234. 448.34 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_and_parse_nested_model PASSED [ 16%]
  235. 450.59 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_and_parse_list_of_models PASSED [ 16%]
  236. 452.31 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_with_tool_like_output PASSED [ 16%]
  237. 454.04 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_formats_nested_images PASSED [ 16%]
  238. 455.83 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_with_code PASSED [ 16%]
  239. 457.63 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_full_prompt PASSED [ 16%]
  240. 459.49 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_for_simple_signature PASSED [ 16%]
  241. 461.23 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_non_native_tool_result_history_field PASSED [ 17%]
  242. 463.18 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_for_two_input_signature PASSED [ 17%]
  243. 465.04 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_with_demo_and_typed_output PASSED [ 17%]
  244. 466.96 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_with_history_demo_pydantic_tools_and_image PASSED [ 17%]
  245. 468.70 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_with_nested_pydantic_output PASSED [ 17%]
  246. 470.51 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_xml_adapter_format_exact_messages_with_incomplete_demo PASSED [ 17%]
  247. 472.41 s [dspy-pytest] tests/adapters/test_xml_adapter.py::test_format_system_message PASSED [ 17%]
  248. 474.29 s [dspy-pytest] tests/callback/test_callback.py::test_callback_injection[args0-kwargs0] PASSED [ 17%]
  249. 476.18 s [dspy-pytest] tests/callback/test_callback.py::test_callback_injection[args1-kwargs1] PASSED [ 17%]
  250. 478.01 s [dspy-pytest] tests/callback/test_callback.py::test_callback_injection[args2-kwargs2] PASSED [ 17%]
  251. 479.94 s [dspy-pytest] tests/callback/test_callback.py::test_callback_injection[args3-kwargs3] PASSED [ 17%]
  252. 481.94 s [dspy-pytest] tests/callback/test_callback.py::test_callback_injection_local PASSED [ 17%]
  253. 483.66 s [dspy-pytest] tests/callback/test_callback.py::test_callback_error_handling PASSED [ 17%]
  254. 485.60 s [dspy-pytest] tests/callback/test_callback.py::test_multiple_callbacks PASSED [ 18%]
  255. 487.29 s [dspy-pytest] tests/callback/test_callback.py::test_callback_complex_module PASSED [ 18%]
  256. 489.11 s [dspy-pytest] tests/callback/test_callback.py::test_callback_async_module PASSED [ 18%]
  257. 490.94 s [dspy-pytest] tests/callback/test_callback.py::test_tool_calls PASSED [ 18%]
  258. 492.77 s [dspy-pytest] tests/callback/test_callback.py::test_active_id PASSED [ 18%]
  259. 496.60 s [dspy-pytest] tests/clients/test_cache.py::test_initialization PASSED [ 18%]
  260. 498.91 s [dspy-pytest] tests/clients/test_cache.py::test_invalid_cache_initialization PASSED [ 18%]
  261. 503.99 s [dspy-pytest] tests/clients/test_cache.py::test_cache_key_generation PASSED [ 18%]
  262. 508.71 s [dspy-pytest] tests/clients/test_cache.py::test_put_and_get PASSED [ 18%]
  263. 513.53 s [dspy-pytest] tests/clients/test_cache.py::test_cache_miss PASSED [ 18%]
  264. 518.51 s [dspy-pytest] tests/clients/test_cache.py::test_unserializable_key PASSED [ 18%]
  265. 522.18 s [dspy-pytest] tests/clients/test_cache.py::test_reset_memory_cache PASSED [ 18%]
  266. 525.85 s [dspy-pytest] tests/clients/test_cache.py::test_save_and_load_memory_cache PASSED [ 18%]
  267. 529.58 s [dspy-pytest] tests/clients/test_cache.py::test_request_cache_decorator PASSED [ 19%]
  268. 533.16 s [dspy-pytest] tests/clients/test_cache.py::test_request_cache_decorator_with_ignored_args_for_cache_key PASSED [ 19%]
  269. 536.86 s [dspy-pytest] tests/clients/test_cache.py::test_request_cache_decorator_async PASSED [ 19%]
  270. 540.31 s [dspy-pytest] tests/clients/test_cache.py::test_cache_consistency_with_lm_call_modifies_the_request PASSED [ 19%]
  271. 542.07 s [dspy-pytest] tests/clients/test_cache.py::test_cache_fallback_on_restricted_environment PASSED [ 19%]
  272. 543.86 s [dspy-pytest] tests/clients/test_cache.py::test_cache_init_with_disk_disabled_and_none_dir PASSED [ 19%]
  273. 547.44 s [dspy-pytest] tests/clients/test_cache.py::test_model_response_roundtrip_in_restricted_mode PASSED [ 19%]
  274. 551.25 s [dspy-pytest] tests/clients/test_cache.py::test_registered_dataclass_roundtrip_in_restricted_mode PASSED [ 19%]
  275. 554.82 s [dspy-pytest] tests/clients/test_cache.py::test_configure_cache_registers_safe_types PASSED [ 19%]
  276. 558.19 s [dspy-pytest] tests/clients/test_cache.py::test_corrupt_disk_entries_return_none PASSED [ 19%]
  277. 563.15 s [dspy-pytest] tests/clients/test_cache.py::test_restricted_and_unrestricted_share_wire_format PASSED [ 19%]
  278. 567.86 s [dspy-pytest] tests/clients/test_cache.py::test_unlisted_type_rejected_on_read PASSED [ 19%]
  279. 570.36 s [dspy-pytest] tests/clients/test_cache.py::test_safe_types_rejects_non_types PASSED [ 19%]
  280. 570.39 s [dspy-pytest] tests/clients/test_databricks.py::test_create_directory_in_databricks_unity_catalog SKIPPED [ 20%]
  281. 570.39 s [dspy-pytest] tests/clients/test_databricks.py::test_create_finetuning_job SKIPPED [ 20%]
  282. 570.39 s [dspy-pytest] tests/clients/test_databricks.py::test_deploy_finetuned_model SKIPPED [ 20%]
  283. 573.45 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_plain_values_roundtrip[dict] PASSED [ 20%]
  284. 576.52 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_plain_values_roundtrip[list] PASSED [ 20%]
  285. 579.92 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_plain_values_roundtrip[str] PASSED [ 20%]
  286. 583.72 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_plain_values_roundtrip[int] PASSED [ 20%]
  287. 586.15 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_plain_values_roundtrip[tuple] PASSED [ 20%]
  288. 588.48 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_pydantic_roundtrip PASSED [ 20%]
  289. 590.55 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_dataclass_roundtrip PASSED [ 20%]
  290. 592.59 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_ndarray_roundtrip PASSED [ 20%]
  291. 594.73 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_litellm_response_roundtrip PASSED [ 20%]
  292. 597.23 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_text_completion_response_roundtrip PASSED [ 20%]
  293. 599.44 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_embedding_response_roundtrip PASSED [ 21%]
  294. 601.57 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_responses_api_roundtrip PASSED [ 21%]
  295. 603.85 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_tool_call_response_roundtrip PASSED [ 21%]
  296. 610.82 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_cached_tool_call_normalizes_after_fresh_process_roundtrip PASSED [ 21%]
  297. 617.10 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_cached_responses_function_call_normalizes_after_fresh_process_roundtrip PASSED [ 21%]
  298. 619.32 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_unlisted_type_blocked_on_read PASSED [ 21%]
  299. 622.08 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_allowlists_are_isolated PASSED [ 21%]
  300. 623.78 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_numpy_ctypeslib_blocked PASSED [ 21%]
  301. 625.46 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_restricted_load_rejects_unknown_type PASSED [ 21%]
  302. 627.15 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_corrupt_pickle_raises_deserialization_error PASSED [ 21%]
  303. 629.33 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_nested_class_safe_types PASSED [ 21%]
  304. 631.09 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_restricted_load_allows_builtin_types PASSED [ 21%]
  305. 632.82 s [dspy-pytest] tests/clients/test_disk_serialization.py::test_all_cached_lm_types_roundtrip PASSED [ 21%]
  306. 634.92 s [dspy-pytest] tests/clients/test_embedding.py::test_litellm_embedding PASSED [ 22%]
  307. 636.99 s [dspy-pytest] tests/clients/test_embedding.py::test_callable_embedding PASSED [ 22%]
  308. 641.09 s [dspy-pytest] tests/clients/test_embedding.py::test_callable_numpy_embedding_persists_to_disk PASSED [ 22%]
  309. 642.81 s [dspy-pytest] tests/clients/test_embedding.py::test_invalid_model_type PASSED [ 22%]
  310. 644.51 s [dspy-pytest] tests/clients/test_embedding.py::test_async_embedding PASSED [ 22%]
  311. 646.73 s [dspy-pytest] tests/clients/test_embedding.py::test_call_caching_false_overrides_instance_true PASSED [ 22%]
  312. 649.89 s [dspy-pytest] tests/clients/test_embedding.py::test_call_caching_true_overrides_instance_false PASSED [ 22%]
  313. 652.56 s [dspy-pytest] tests/clients/test_embedding.py::test_acall_caching_false_overrides_instance_true PASSED [ 22%]
  314. 655.37 s [dspy-pytest] tests/clients/test_embedding.py::test_acall_caching_true_overrides_instance_false PASSED [ 22%]
  315. 657.78 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_history_basic PASSED [ 22%]
  316. 660.06 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_history_renders_message_tool_calls PASSED [ 22%]
  317. 662.50 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_history_renders_output_tool_calls_without_text PASSED [ 22%]
  318. 665.68 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_history_with_n PASSED [ 22%]
  319. 668.08 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_empty_history PASSED [ 23%]
  320. 670.15 s [dspy-pytest] tests/clients/test_inspect_global_history.py::test_inspect_history_n_larger_than_history PASSED [ 23%]
  321. 671.94 s [dspy-pytest] tests/clients/test_lazy_litellm_import.py::test_import_dspy_does_not_import_litellm PASSED [ 23%]
  322. 673.67 s [dspy-pytest] tests/clients/test_lazy_litellm_import.py::test_lm_litellm_use_raises_helpful_error_without_litellm PASSED [ 23%]
  323. 675.51 s [dspy-pytest] tests/clients/test_lazy_litellm_import.py::test_embedder_litellm_use_raises_helpful_error_without_litellm PASSED [ 23%]
  324. 677.34 s [dspy-pytest] tests/clients/test_lazy_litellm_import.py::test_concurrent_lm_first_use_materializes_litellm_once PASSED [ 23%]
  325. 682.19 s [dspy-pytest] tests/clients/test_lm.py::test_chat_lms_can_be_queried PASSED [ 23%]
  326. 688.24 s [dspy-pytest] tests/clients/test_lm.py::test_dspy_cache PASSED [ 23%]
  327. 689.99 s [dspy-pytest] tests/clients/test_lm.py::test_disabled_cache_skips_cache_key PASSED [ 23%]
  328. 693.82 s [dspy-pytest] tests/clients/test_lm.py::test_rollout_id_bypasses_cache PASSED [ 23%]
  329. 695.87 s [dspy-pytest] tests/clients/test_lm.py::test_zero_temperature_rollout_warns_once PASSED [ 23%]
  330. 697.80 s [dspy-pytest] tests/clients/test_lm.py::test_rollout_id_with_default_temperature_does_not_warn PASSED [ 23%]
  331. 702.50 s [dspy-pytest] tests/clients/test_lm.py::test_text_lms_can_be_queried PASSED [ 23%]
  332. 706.54 s [dspy-pytest] tests/clients/test_lm.py::test_lm_calls_support_callables PASSED [ 23%]
  333. 711.46 s [dspy-pytest] tests/clients/test_lm.py::test_lm_calls_support_pydantic_models PASSED [ 24%]
  334. 713.29 s [dspy-pytest] tests/clients/test_lm.py::test_lm_wraps_litellm_errors_with_metadata PASSED [ 24%]
  335. 715.04 s [dspy-pytest] tests/clients/test_lm.py::test_lm_wraps_litellm_context_window_error PASSED [ 24%]
  336. 716.83 s [dspy-pytest] tests/clients/test_lm.py::test_lm_wraps_unknown_boundary_error_as_unexpected_error PASSED [ 24%]
  337. 718.66 s [dspy-pytest] tests/clients/test_lm.py::test_lm_preserves_existing_lm_error_without_self_cause PASSED [ 24%]
  338. 720.42 s [dspy-pytest] tests/clients/test_lm.py::test_lm_preserves_existing_lm_error_without_self_cause_async PASSED [ 24%]
  339. 722.38 s [dspy-pytest] tests/clients/test_lm.py::test_retry_number_set_correctly PASSED [ 24%]
  340. 727.48 s [dspy-pytest] tests/clients/test_lm.py::test_retry_made_on_system_errors PASSED [ 24%]
  341. 729.27 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_token_parameter PASSED [ 24%]
  342. 731.09 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_requirements[openai/o1] PASSED [ 24%]
  343. 732.89 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_requirements[openai/gpt-5-nano] PASSED [ 24%]
  344. 734.66 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_requirements[openai/gpt-5-mini] PASSED [ 24%]
  345. 736.28 s [dspy-pytest] tests/clients/test_lm.py::test_gpt_5_chat_not_reasoning_model PASSED [ 24%]
  346. 737.88 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_init_uses_lm_defaults_and_isolates_callback_list PASSED [ 25%]
  347. 739.56 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_forward_contract_defaults_to_legacy PASSED [ 25%]
  348. 741.24 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_forward_contract_accepts_explicit_values PASSED [ 25%]
  349. 742.95 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_forward_contract_rejects_unknown_values PASSED [ 25%]
  350. 744.77 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_validates_typed_lm_response PASSED [ 25%]
  351. 746.54 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_warns_when_inherited_legacy_forward_returns_lm_response PASSED [ 25%]
  352. 748.30 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_errors_when_explicit_legacy_forward_returns_lm_response PASSED [ 25%]
  353. 749.98 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_inherited_legacy_forward_returning_lm_response_errors_on_direct_call PASSED [ 25%]
  354. 751.70 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_default_call_keeps_legacy_outputs PASSED [ 25%]
  355. 753.46 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_call_returns_lm_response_through_legacy_bridge PASSED [ 25%]
  356. 755.24 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_explicit_lm_request_returns_lm_response_without_experimental PASSED [ 25%]
  357. 756.96 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_legacy_bridge_records_typed_history_and_usage_once PASSED [ 25%]
  358. 758.81 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_typed_forward_contract_uses_lm_request PASSED [ 25%]
  359. 760.61 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_typed_forward_contract_rejects_non_lm_response_at_call_time PASSED [ 26%]
  360. 762.45 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_request_call_rejects_mixed_inputs PASSED [ 26%]
  361. 764.17 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_support_system_user_and_assistant_turns[current_lm] PASSED [ 26%]
  362. 765.98 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_support_system_user_and_assistant_turns[typed_lm] PASSED [ 26%]
  363. 767.81 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_support_tool_call_transcripts[current_lm] PASSED [ 26%]
  364. 769.53 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_support_tool_call_transcripts[typed_lm] PASSED [ 26%]
  365. 771.29 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_can_reuse_lm_response_as_assistant_turn[current_lm] PASSED [ 26%]
  366. 773.08 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_experimental_direct_messages_can_reuse_lm_response_as_assistant_turn[typed_lm] PASSED [ 26%]
  367. 774.82 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_async_explicit_lm_request_returns_lm_response PASSED [ 26%]
  368. 776.58 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_tracks_usage_for_custom_subclasses PASSED [ 26%]
  369. 778.21 s [dspy-pytest] tests/clients/test_lm.py::test_base_lm_copy_is_shallow_runtime_copy_with_isolated_dspy_state PASSED [ 26%]
  370. 779.62 s [dspy-pytest] tests/clients/test_lm.py::test_dump_state PASSED [ 26%]
  371. 781.19 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_dump_state_uses_constructor_max_tokens PASSED [ 26%]
  372. 783.07 s [dspy-pytest] tests/clients/test_lm.py::test_dump_state_preserves_enabled_developer_role PASSED [ 27%]
  373. 784.60 s [dspy-pytest] tests/clients/test_lm.py::test_dump_state_ignores_internal_class_marker_kwarg PASSED [ 27%]
  374. 786.05 s [dspy-pytest] tests/clients/test_lm.py::test_load_state PASSED [ 27%]
  375. 787.44 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_load_state_round_trips_canonical_state PASSED [ 27%]
  376. 789.18 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_model_load_state_accepts_max_completion_tokens_alias PASSED [ 27%]
  377. 791.05 s [dspy-pytest] tests/clients/test_lm.py::test_lm_load_state_forwards_allow_custom_lm_class PASSED [ 27%]
  378. 795.93 s [dspy-pytest] tests/clients/test_lm.py::test_exponential_backoff_retry PASSED [ 27%]
  379. 797.68 s [dspy-pytest] tests/clients/test_lm.py::test_logprobs_included_when_requested PASSED [ 27%]
  380. 799.49 s [dspy-pytest] tests/clients/test_lm.py::test_async_lm_call PASSED [ 27%]
  381. 802.75 s [dspy-pytest] tests/clients/test_lm.py::test_async_lm_call_with_cache PASSED [ 27%]
  382. 804.38 s [dspy-pytest] tests/clients/test_lm.py::test_lm_history_size_limit PASSED [ 27%]
  383. 806.35 s [dspy-pytest] tests/clients/test_lm.py::test_disable_history PASSED [ 27%]
  384. 807.87 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api PASSED [ 27%]
  385. 809.35 s [dspy-pytest] tests/clients/test_lm.py::test_lm_replaces_system_with_developer_role PASSED [ 28%]
  386. 814.13 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_tool_calls PASSED [ 28%]
  387. 815.80 s [dspy-pytest] tests/clients/test_lm.py::test_reasoning_effort_responses_api PASSED [ 28%]
  388. 817.50 s [dspy-pytest] tests/clients/test_lm.py::test_call_reasoning_model_with_chat_api PASSED [ 28%]
  389. 819.20 s [dspy-pytest] tests/clients/test_lm.py::test_api_key_not_saved_in_json PASSED [ 28%]
  390. 820.96 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_converts_images_correctly PASSED [ 28%]
  391. 822.71 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_converts_files_correctly PASSED [ 28%]
  392. 824.38 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_preserves_multi_message_structure PASSED [ 28%]
  393. 826.07 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_with_image_input PASSED [ 28%]
  394. 827.67 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_with_pydantic_model_input PASSED [ 28%]
  395. 829.09 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_with_none_usage PASSED [ 28%]
  396. 830.50 s [dspy-pytest] tests/clients/test_lm.py::test_responses_api_with_none_usage_async PASSED [ 28%]
  397. 832.35 s [dspy-pytest] tests/clients/test_lm.py::test_streaming_passes_headers_correctly PASSED [ 28%]
  398. 832.35 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_chat_direct_system_user_assistant_multiturn SKIPPED [ 29%]
  399. 832.36 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_chat_direct_tool_call_transcript SKIPPED [ 29%]
  400. 832.36 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_chat_direct_reuse_lm_response_as_assistant_turn SKIPPED [ 29%]
  401. 832.36 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_responses_direct_system_user_assistant_multiturn SKIPPED [ 29%]
  402. 832.36 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_responses_direct_tool_call_transcript SKIPPED [ 29%]
  403. 832.36 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_openai_responses_direct_reuse_lm_response_as_assistant_turn SKIPPED [ 29%]
  404. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_anthropic_chat_direct_system_user_assistant_multiturn SKIPPED [ 29%]
  405. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_anthropic_chat_direct_tool_call_transcript SKIPPED [ 29%]
  406. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_anthropic_chat_direct_reuse_lm_response_as_assistant_turn SKIPPED [ 29%]
  407. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_gemini_chat_direct_system_user_assistant_multiturn SKIPPED [ 29%]
  408. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_gemini_chat_direct_tool_call_transcript SKIPPED [ 29%]
  409. 832.38 s [dspy-pytest] tests/clients/test_lm_direct_live.py::test_live_gemini_chat_direct_reuse_lm_response_as_assistant_turn SKIPPED [ 29%]
  410. 834.16 s [dspy-pytest] tests/clients/test_lm_local.py::test_command_with_spaces_in_path PASSED [ 29%]
  411. 836.11 s [dspy-pytest] tests/clients/test_lm_local.py::test_command_construction_prevents_injection PASSED [ 30%]
  412. 837.81 s [dspy-pytest] tests/clients/test_lm_local.py::test_command_is_list_not_string PASSED [ 30%]
  413. 839.54 s [dspy-pytest] tests/core/test_types.py::test_message_content_and_tool_calls_normalize_for_dspy_history_surface PASSED [ 30%]
  414. 841.26 s [dspy-pytest] tests/core/test_types.py::test_tool_result_content_none_normalizes_to_empty_parts PASSED [ 30%]
  415. 843.20 s [dspy-pytest] tests/core/test_types.py::test_audio_content_accepts_url_and_history_preserves_url PASSED [ 30%]
  416. 845.03 s [dspy-pytest] tests/core/test_types.py::test_audio_content_defaults_null_format_to_wav PASSED [ 30%]
  417. 846.85 s [dspy-pytest] tests/core/test_types.py::test_image_content_requires_mapping_with_url PASSED [ 30%]
  418. 848.71 s [dspy-pytest] tests/core/test_types.py::test_video_data_round_trips_through_history_messages PASSED [ 30%]
  419. 850.58 s [dspy-pytest] tests/core/test_types.py::test_document_source_url_stays_url_and_round_trips_through_history_messages PASSED [ 30%]
  420. 852.38 s [dspy-pytest] tests/core/test_types.py::test_config_extensions_flatten_when_converted_to_legacy_kwargs PASSED [ 30%]
  421. 854.05 s [dspy-pytest] tests/core/test_types.py::test_lm_kwargs_aliases_normalize_for_existing_dspy_lm_callers PASSED [ 30%]
  422. 855.69 s [dspy-pytest] tests/core/test_types.py::test_nested_config_aliases_remain_supported_for_existing_interfaces PASSED [ 30%]
  423. 857.44 s [dspy-pytest] tests/core/test_types.py::test_usage_normalizes_existing_user_visible_token_aliases PASSED [ 30%]
  424. 859.43 s [dspy-pytest] tests/core/test_types.py::test_default_config_does_not_serialize_empty_stop_sequences PASSED [ 30%]
  425. 861.35 s [dspy-pytest] tests/core/test_types.py::test_history_entry_exposes_existing_dict_style_properties PASSED [ 31%]
  426. 863.21 s [dspy-pytest] tests/core/test_types.py::test_response_rejects_empty_outputs PASSED [ 31%]
  427. 865.10 s [dspy-pytest] tests/core/test_types.py::test_output_to_value_preserves_redacted_thinking_part PASSED [ 31%]
  428. 867.02 s [dspy-pytest] tests/core/test_types.py::test_stream_event_indices_must_be_non_negative PASSED [ 31%]
  429. 868.83 s [dspy-pytest] tests/core/test_types.py::test_stream_builder_rejects_sparse_output_indices PASSED [ 31%]
  430. 870.48 s [dspy-pytest] tests/core/test_types.py::test_stream_builder_rejects_sparse_part_indices PASSED [ 31%]
  431. 872.25 s [dspy-pytest] tests/core/test_types.py::test_stream_builder_rejects_delta_type_changes PASSED [ 31%]
  432. 873.59 s [dspy-pytest] tests/core/test_types.py::test_stream_builder_rejects_incomplete_tool_call_arguments PASSED [ 31%]
  433. 873.59 s [dspy-pytest] tests/datasets/test_dataset.py::test_input_keys SKIPPED (need --extra
  434. 873.59 s [dspy-pytest] option to run) [ 31%]
  435. 875.16 s [dspy-pytest] tests/docs/test_mkdocs_links.py::test_nav_files_exist PASSED [ 31%]
  436. 877.07 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_semantic_f1_returns_prediction_without_trace PASSED [ 31%]
  437. 878.83 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_semantic_f1_returns_prediction_with_trace PASSED [ 31%]
  438. 880.75 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_semantic_f1_score_value PASSED [ 31%]
  439. 882.60 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_complete_and_grounded_returns_prediction_without_trace PASSED [ 32%]
  440. 884.33 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_complete_and_grounded_returns_prediction_with_trace PASSED [ 32%]
  441. 886.29 s [dspy-pytest] tests/evaluate/test_auto_evaluation.py::test_semantic_f1_prediction_can_be_compared PASSED [ 32%]
  442. 888.08 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_initialization PASSED [ 32%]
  443. 889.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_call PASSED [ 32%]
  444. 891.29 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_single_thread_runs_in_main_thread PASSED [ 32%]
  445. 891.29 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_construct_result_df SKIPPED (need
  446. 891.29 s [dspy-pytest] --extra option to run) [ 32%]
  447. 893.00 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_multithread_evaluate_call PASSED [ 32%]
  448. 895.78 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_multi_thread_evaluate_call_cancelled PASSED [ 32%]
  449. 897.49 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_call_wrong_answer PASSED [ 32%]
  450. 897.49 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-True-program_with_example0] SKIPPED [ 32%]
  451. 897.49 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-True-program_with_example1] SKIPPED [ 32%]
  452. 897.49 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-True-program_with_example2] SKIPPED [ 32%]
  453. 897.49 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-True-program_with_example3] SKIPPED [ 33%]
  454. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-False-program_with_example0] SKIPPED [ 33%]
  455. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-False-program_with_example1] SKIPPED [ 33%]
  456. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-False-program_with_example2] SKIPPED [ 33%]
  457. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-False-program_with_example3] SKIPPED [ 33%]
  458. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-1-program_with_example0] SKIPPED [ 33%]
  459. 897.50 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-1-program_with_example1] SKIPPED [ 33%]
  460. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-1-program_with_example2] SKIPPED [ 33%]
  461. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[True-1-program_with_example3] SKIPPED [ 33%]
  462. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-True-program_with_example0] SKIPPED [ 33%]
  463. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-True-program_with_example1] SKIPPED [ 33%]
  464. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-True-program_with_example2] SKIPPED [ 33%]
  465. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-True-program_with_example3] SKIPPED [ 33%]
  466. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-False-program_with_example0] SKIPPED [ 34%]
  467. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-False-program_with_example1] SKIPPED [ 34%]
  468. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-False-program_with_example2] SKIPPED [ 34%]
  469. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-False-program_with_example3] SKIPPED [ 34%]
  470. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-1-program_with_example0] SKIPPED [ 34%]
  471. 897.54 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-1-program_with_example1] SKIPPED [ 34%]
  472. 897.55 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-1-program_with_example2] SKIPPED [ 34%]
  473. 897.55 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_display_table[False-1-program_with_example3] SKIPPED [ 34%]
  474. 899.24 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_callback PASSED [ 34%]
  475. 900.95 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluation_result_repr PASSED [ 34%]
  476. 902.78 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_save_as_json_with_history PASSED [ 34%]
  477. 904.64 s [dspy-pytest] tests/evaluate/test_evaluate.py::test_evaluate_save_as_csv_with_history PASSED [ 34%]
  478. 906.35 s [dspy-pytest] tests/evaluate/test_metrics.py::test_answer_exact_match_string PASSED [ 34%]
  479. 908.28 s [dspy-pytest] tests/evaluate/test_metrics.py::test_answer_exact_match_list PASSED [ 35%]
  480. 910.15 s [dspy-pytest] tests/evaluate/test_metrics.py::test_answer_exact_match_no_match PASSED [ 35%]
  481. 911.83 s [dspy-pytest] tests/metadata/test_metadata.py::test_metadata PASSED [ 35%]
  482. 913.48 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_prediction PASSED [ 35%]
  483. 914.84 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_completions PASSED [ 35%]
  484. 916.44 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_list PASSED [ 35%]
  485. 918.23 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_normalize PASSED [ 35%]
  486. 919.98 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_field PASSED [ 35%]
  487. 922.03 s [dspy-pytest] tests/predict/test_aggregation.py::test_majority_with_no_majority PASSED [ 35%]
  488. 924.19 s [dspy-pytest] tests/predict/test_best_of_n.py::test_refine_forward_success_first_attempt PASSED [ 35%]
  489. 926.28 s [dspy-pytest] tests/predict/test_best_of_n.py::test_refine_module_default_fail_count PASSED [ 35%]
  490. 928.28 s [dspy-pytest] tests/predict/test_best_of_n.py::test_refine_module_custom_fail_count PASSED [ 35%]
  491. 930.31 s [dspy-pytest] tests/predict/test_chain_of_thought.py::test_initialization_with_string_signature PASSED [ 35%]
  492. 932.38 s [dspy-pytest] tests/predict/test_chain_of_thought.py::test_async_chain_of_thought PASSED [ 36%]
  493. 934.31 s [dspy-pytest] tests/predict/test_chain_of_thought.py::test_chain_of_thought_with_native_reasoning PASSED [ 36%]
  494. 936.35 s [dspy-pytest] tests/predict/test_chain_of_thought.py::test_chain_of_thought_with_manual_reasoning PASSED [ 36%]
  495. 936.35 s [dspy-pytest] tests/predict/test_code_act.py::test_codeact_code_generation SKIPPED [ 36%]
  496. 936.36 s [dspy-pytest] tests/predict/test_code_act.py::test_codeact_support_multiple_fields SKIPPED [ 36%]
  497. 936.36 s [dspy-pytest] tests/predict/test_code_act.py::test_codeact_code_parse_failure SKIPPED [ 36%]
  498. 936.36 s [dspy-pytest] tests/predict/test_code_act.py::test_codeact_code_execution_failure SKIPPED [ 36%]
  499. 936.36 s [dspy-pytest] tests/predict/test_code_act.py::test_codeact_tool_validation SKIPPED [ 36%]
  500. 936.36 s [dspy-pytest] tests/predict/test_knn.py::test_knn_initialization SKIPPED (need --extra
  501. 936.36 s [dspy-pytest] option to run) [ 36%]
  502. 936.36 s [dspy-pytest] tests/predict/test_knn.py::test_knn_query SKIPPED (need --extra option
  503. 936.36 s [dspy-pytest] to run) [ 36%]
  504. 936.36 s [dspy-pytest] tests/predict/test_knn.py::test_knn_query_specificity SKIPPED (need
  505. 936.36 s [dspy-pytest] --extra option to run) [ 36%]
  506. 938.27 s [dspy-pytest] tests/predict/test_multi_chain_comparison.py::test_basic_example PASSED [ 36%]
  507. 939.90 s [dspy-pytest] tests/predict/test_parallel.py::test_parallel_module PASSED [ 36%]
  508. 941.28 s [dspy-pytest] tests/predict/test_parallel.py::test_batch_module PASSED [ 37%]
  509. 943.11 s [dspy-pytest] tests/predict/test_parallel.py::test_nested_parallel_module PASSED [ 37%]
  510. 944.91 s [dspy-pytest] tests/predict/test_parallel.py::test_nested_batch_method PASSED [ 37%]
  511. 946.76 s [dspy-pytest] tests/predict/test_parallel.py::test_batch_with_failed_examples PASSED [ 37%]
  512. 948.74 s [dspy-pytest] tests/predict/test_parallel.py::test_parallel_timeout_and_straggler_limit_params PASSED [ 37%]
  513. 950.49 s [dspy-pytest] tests/predict/test_parallel.py::test_batch_timeout_and_straggler_limit_params PASSED [ 37%]
  514. 952.25 s [dspy-pytest] tests/predict/test_predict.py::test_initialization_with_string_signature PASSED [ 37%]
  515. 954.10 s [dspy-pytest] tests/predict/test_predict.py::test_reset_method PASSED [ 37%]
  516. 955.90 s [dspy-pytest] tests/predict/test_predict.py::test_lm_after_dump_and_load_state PASSED [ 37%]
  517. 957.72 s [dspy-pytest] tests/predict/test_predict.py::test_base_lm_dump_state_ignores_internal_class_marker_kwarg PASSED [ 37%]
  518. 959.65 s [dspy-pytest] tests/predict/test_predict.py::test_legacy_lm_state_without_class_marker_loads_as_lm PASSED [ 37%]
  519. 961.45 s [dspy-pytest] tests/predict/test_predict.py::test_custom_lm_load_state_requires_trusted_opt_in PASSED [ 37%]
  520. 963.42 s [dspy-pytest] tests/predict/test_predict.py::test_nested_custom_lm_class_path_loads_for_trusted_state PASSED [ 37%]
  521. 965.13 s [dspy-pytest] tests/predict/test_predict.py::test_call_method PASSED [ 38%]
  522. 966.82 s [dspy-pytest] tests/predict/test_predict.py::test_instructions_after_dump_and_load_state PASSED [ 38%]
  523. 968.59 s [dspy-pytest] tests/predict/test_predict.py::test_demos_after_dump_and_load_state PASSED [ 38%]
  524. 970.40 s [dspy-pytest] tests/predict/test_predict.py::test_typed_demos_after_dump_and_load_state PASSED [ 38%]
  525. 972.32 s [dspy-pytest] tests/predict/test_predict.py::test_signature_fields_after_dump_and_load_state PASSED [ 38%]
  526. 974.18 s [dspy-pytest] tests/predict/test_predict.py::test_lm_field_after_dump_and_load_state[model.json] PASSED [ 38%]
  527. 975.85 s [dspy-pytest] tests/predict/test_predict.py::test_lm_field_after_dump_and_load_state[model.pkl] PASSED [ 38%]
  528. 977.50 s [dspy-pytest] tests/predict/test_predict.py::test_load_ignores_serialized_endpoint_override_by_default[api_base] PASSED [ 38%]
  529. 979.23 s [dspy-pytest] tests/predict/test_predict.py::test_load_ignores_serialized_endpoint_override_by_default[base_url] PASSED [ 38%]
  530. 981.03 s [dspy-pytest] tests/predict/test_predict.py::test_load_allows_serialized_endpoint_override_with_opt_in[api_base] PASSED [ 38%]
  531. 982.88 s [dspy-pytest] tests/predict/test_predict.py::test_load_allows_serialized_endpoint_override_with_opt_in[base_url] PASSED [ 38%]
  532. 984.66 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_ignores_serialized_endpoint_override_by_default[api_base] PASSED [ 38%]
  533. 986.50 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_ignores_serialized_endpoint_override_by_default[base_url] PASSED [ 38%]
  534. 988.19 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_allows_serialized_endpoint_override_with_opt_in[api_base] PASSED [ 38%]
  535. 989.89 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_allows_serialized_endpoint_override_with_opt_in[base_url] PASSED [ 39%]
  536. 991.69 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_ignores_serialized_model_list_endpoint_override_by_default PASSED [ 39%]
  537. 993.53 s [dspy-pytest] tests/predict/test_predict.py::test_load_prevents_serialized_endpoint_override_reaching_litellm[api_base] PASSED [ 39%]
  538. 995.31 s [dspy-pytest] tests/predict/test_predict.py::test_load_prevents_serialized_endpoint_override_reaching_litellm[base_url] PASSED [ 39%]
  539. 996.97 s [dspy-pytest] tests/predict/test_predict.py::test_load_blocks_serialized_model_list_unless_opted_in PASSED [ 39%]
  540. 998.63 s [dspy-pytest] tests/predict/test_predict.py::test_load_uses_env_api_key_without_honoring_serialized_endpoint_override PASSED [ 39%]
  541. 1000.23 s [dspy-pytest] tests/predict/test_predict.py::test_forward_method PASSED [ 39%]
  542. 1001.98 s [dspy-pytest] tests/predict/test_predict.py::test_forward_method2 PASSED [ 39%]
  543. 1003.66 s [dspy-pytest] tests/predict/test_predict.py::test_config_management PASSED [ 39%]
  544. 1005.44 s [dspy-pytest] tests/predict/test_predict.py::test_multi_output PASSED [ 39%]
  545. 1007.13 s [dspy-pytest] tests/predict/test_predict.py::test_multi_output2 PASSED [ 39%]
  546. 1008.82 s [dspy-pytest] tests/predict/test_predict.py::test_datetime_inputs_and_outputs PASSED [ 39%]
  547. 1010.54 s [dspy-pytest] tests/predict/test_predict.py::test_explicitly_valued_enum_inputs_and_outputs PASSED [ 39%]
  548. 1012.37 s [dspy-pytest] tests/predict/test_predict.py::test_enum_inputs_and_outputs_with_shared_names_and_values PASSED [ 40%]
  549. 1014.09 s [dspy-pytest] tests/predict/test_predict.py::test_auto_valued_enum_inputs_and_outputs PASSED [ 40%]
  550. 1015.70 s [dspy-pytest] tests/predict/test_predict.py::test_named_predictors PASSED [ 40%]
  551. 1017.32 s [dspy-pytest] tests/predict/test_predict.py::test_output_only PASSED [ 40%]
  552. 1018.96 s [dspy-pytest] tests/predict/test_predict.py::test_load_state_chaining PASSED [ 40%]
  553. 1020.55 s [dspy-pytest] tests/predict/test_predict.py::test_call_predict_with_chat_history[chat] PASSED [ 40%]
  554. 1022.60 s [dspy-pytest] tests/predict/test_predict.py::test_call_predict_with_chat_history[json] PASSED [ 40%]
  555. 1024.74 s [dspy-pytest] tests/predict/test_predict.py::test_lm_usage PASSED [ 40%]
  556. 1027.22 s [dspy-pytest] tests/predict/test_predict.py::test_lm_usage_with_parallel PASSED [ 40%]
  557. 1029.92 s [dspy-pytest] tests/predict/test_predict.py::test_lm_usage_with_async PASSED [ 40%]
  558. 1031.85 s [dspy-pytest] tests/predict/test_predict.py::test_positional_arguments PASSED [ 40%]
  559. 1033.88 s [dspy-pytest] tests/predict/test_predict.py::test_error_message_on_invalid_lm_setup PASSED [ 40%]
  560. 1036.04 s [dspy-pytest] tests/predict/test_predict.py::test_field_constraints[chat] PASSED [ 40%]
  561. 1037.73 s [dspy-pytest] tests/predict/test_predict.py::test_field_constraints[json] PASSED [ 41%]
  562. 1039.57 s [dspy-pytest] tests/predict/test_predict.py::test_async_predict PASSED [ 41%]
  563. 1041.48 s [dspy-pytest] tests/predict/test_predict.py::test_predicted_outputs_piped_from_predict_to_lm_call PASSED [ 41%]
  564. 1043.42 s [dspy-pytest] tests/predict/test_predict.py::test_dump_state_pydantic_non_primitive_types PASSED [ 41%]
  565. 1045.16 s [dspy-pytest] tests/predict/test_predict.py::test_trace_size_limit PASSED [ 41%]
  566. 1047.05 s [dspy-pytest] tests/predict/test_predict.py::test_disable_trace PASSED [ 41%]
  567. 1049.06 s [dspy-pytest] tests/predict/test_predict.py::test_per_module_history_size_limit PASSED [ 41%]
  568. 1051.02 s [dspy-pytest] tests/predict/test_predict.py::test_per_module_history_disabled PASSED [ 41%]
  569. 1052.84 s [dspy-pytest] tests/predict/test_predict.py::test_input_field_default_value PASSED [ 41%]
  570. 1054.64 s [dspy-pytest] tests/predict/test_predict.py::test_extra_fields_warning PASSED [ 41%]
  571. 1056.45 s [dspy-pytest] tests/predict/test_predict.py::test_missing_optional_input_field_no_warning PASSED [ 41%]
  572. 1058.24 s [dspy-pytest] tests/predict/test_predict.py::test_missing_required_input_field_still_warns PASSED [ 41%]
  573. 1060.06 s [dspy-pytest] tests/predict/test_predict.py::test_warning_images PASSED [ 41%]
  574. 1061.82 s [dspy-pytest] tests/predict/test_predict.py::test_type_mismatch_warning PASSED [ 42%]
  575. 1063.54 s [dspy-pytest] tests/predict/test_predict.py::test_correct_types_no_warning PASSED [ 42%]
  576. 1065.29 s [dspy-pytest] tests/predict/test_predict.py::test_list_type_validation PASSED [ 42%]
  577. 1066.97 s [dspy-pytest] tests/predict/test_predict.py::test_literal_type_validation PASSED [ 42%]
  578. 1068.71 s [dspy-pytest] tests/predict/test_predict.py::test_literal_union_type_validation PASSED [ 42%]
  579. 1070.25 s [dspy-pytest] tests/predict/test_predict.py::test_list_string PASSED [ 42%]
  580. 1071.99 s [dspy-pytest] tests/predict/test_predict.py::test_nested_list_type_validation PASSED [ 42%]
  581. 1073.66 s [dspy-pytest] tests/predict/test_predict.py::test_nested_dict_type_validation PASSED [ 42%]
  582. 1075.28 s [dspy-pytest] tests/predict/test_predict.py::test_nested_tuple_type_validation PASSED [ 42%]
  583. 1076.86 s [dspy-pytest] tests/predict/test_predict.py::test_literal_type_validation_string_signature PASSED [ 42%]
  584. 1078.50 s [dspy-pytest] tests/predict/test_predict.py::test_list_type_validation_string_signature PASSED [ 42%]
  585. 1080.12 s [dspy-pytest] tests/predict/test_predict.py::test_dict_type_validation_string_signature PASSED [ 42%]
  586. 1081.76 s [dspy-pytest] tests/predict/test_predict.py::test_tuple_type_validation_string_signature PASSED [ 42%]
  587. 1083.45 s [dspy-pytest] tests/predict/test_predict.py::test_union_type_validation_string_signature PASSED [ 43%]
  588. 1085.10 s [dspy-pytest] tests/predict/test_predict.py::test_basic_types_string_signature[False] PASSED [ 43%]
  589. 1086.82 s [dspy-pytest] tests/predict/test_predict.py::test_basic_types_string_signature[True] PASSED [ 43%]
  590. 1088.42 s [dspy-pytest] tests/predict/test_predict.py::test_untyped_string_signature PASSED [ 43%]
  591. 1090.06 s [dspy-pytest] tests/predict/test_predict.py::test_untyped_class_signature PASSED [ 43%]
  592. 1091.64 s [dspy-pytest] tests/predict/test_predict.py::test_string_to_list_signature PASSED [ 43%]
  593. 1093.27 s [dspy-pytest] tests/predict/test_predict.py::test_custom_signature_types[False] PASSED [ 43%]
  594. 1094.90 s [dspy-pytest] tests/predict/test_predict.py::test_custom_signature_types[True] PASSED [ 43%]
  595. 1094.90 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_pot_code_generation SKIPPED [ 43%]
  596. 1094.90 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_old_style_pot SKIPPED [ 43%]
  597. 1094.90 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_pot_support_multiple_fields SKIPPED [ 43%]
  598. 1094.90 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_pot_code_generation_with_one_error SKIPPED [ 43%]
  599. 1094.90 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_pot_code_generation_persistent_errors SKIPPED [ 43%]
  600. 1096.61 s [dspy-pytest] tests/predict/test_program_of_thought.py::test_pot_code_parse_error PASSED [ 44%]
  601. 1096.61 s [dspy-pytest] tests/predict/test_react.py::test_tool_observation_preserves_custom_type SKIPPED [ 44%]
  602. 1098.38 s [dspy-pytest] tests/predict/test_react.py::test_tool_calling_with_pydantic_args PASSED [ 44%]
  603. 1100.13 s [dspy-pytest] tests/predict/test_react.py::test_react_with_tools_skips_native_response_issubclass_for_generic_alias PASSED [ 44%]
  604. 1101.82 s [dspy-pytest] tests/predict/test_react.py::test_tool_calling_without_typehint PASSED [ 44%]
  605. 1103.55 s [dspy-pytest] tests/predict/test_react.py::test_trajectory_truncation PASSED [ 44%]
  606. 1105.20 s [dspy-pytest] tests/predict/test_react.py::test_context_window_exceeded_after_retries PASSED [ 44%]
  607. 1107.23 s [dspy-pytest] tests/predict/test_react.py::test_error_retry PASSED [ 44%]
  608. 1108.99 s [dspy-pytest] tests/predict/test_react.py::test_async_tool_calling_with_pydantic_args PASSED [ 44%]
  609. 1110.68 s [dspy-pytest] tests/predict/test_react.py::test_async_error_retry PASSED [ 44%]
  610. 1112.33 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_submit_tool_returns_original_output_fields PASSED [ 44%]
  611. 1114.28 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_text_mock_lm_loop_records_inputs_once PASSED [ 44%]
  612. 1116.05 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_continuation_omits_missing_original_inputs PASSED [ 44%]
  613. 1117.77 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_text_mode_accepts_top_level_tool_arguments PASSED [ 45%]
  614. 1119.63 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_text_mode_accepts_wrapped_submit_arguments PASSED [ 45%]
  615. 1121.51 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_unknown_tool_observation_can_continue PASSED [ 45%]
  616. 1123.41 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_accepts_serialized_history_input PASSED [ 45%]
  617. 1125.16 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_forced_submit_on_empty_tool_calls PASSED [ 45%]
  618. 1126.90 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_native_tool_loop_replays_tool_result_with_provider_id PASSED [ 45%]
  619. 1128.72 s [dspy-pytest] tests/predict/test_react_v2.py::test_react_v2_native_parallel_tool_calls_are_requested_and_replayed PASSED [ 45%]
  620. 1130.65 s [dspy-pytest] tests/predict/test_refine.py::test_refine_forward_success_first_attempt PASSED [ 45%]
  621. 1132.57 s [dspy-pytest] tests/predict/test_refine.py::test_refine_module_default_fail_count PASSED [ 45%]
  622. 1134.31 s [dspy-pytest] tests/predict/test_refine.py::test_refine_module_custom_fail_count PASSED [ 45%]
  623. 1136.04 s [dspy-pytest] tests/predict/test_rlm.py::TestMockInterpreter::test_scripted_responses PASSED [ 45%]
  624. 1137.87 s [dspy-pytest] tests/predict/test_rlm.py::TestMockInterpreter::test_returns_final_output_result PASSED [ 45%]
  625. 1139.69 s [dspy-pytest] tests/predict/test_rlm.py::TestMockInterpreter::test_raises_exception_from_responses PASSED [ 45%]
  626. 1141.62 s [dspy-pytest] tests/predict/test_rlm.py::TestMockInterpreter::test_records_call_history PASSED [ 46%]
  627. 1143.34 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_basic_initialization PASSED [ 46%]
  628. 1145.20 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_custom_signature PASSED [ 46%]
  629. 1147.10 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_custom_tools PASSED [ 46%]
  630. 1148.87 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_invalid_identifier[invalid-name] PASSED [ 46%]
  631. 1150.65 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_invalid_identifier[123start] PASSED [ 46%]
  632. 1152.78 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_reserved_names[llm_query] PASSED [ 46%]
  633. 1154.78 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_reserved_names[SUBMIT] PASSED [ 46%]
  634. 1156.45 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_reserved_names[print] PASSED [ 46%]
  635. 1158.11 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_not_callable[not a function] PASSED [ 46%]
  636. 1159.87 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tool_validation_not_callable[123] PASSED [ 46%]
  637. 1161.56 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tools_dict_rejected PASSED [ 46%]
  638. 1163.32 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_optional_parameters PASSED [ 46%]
  639. 1165.04 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_forward_validates_required_inputs PASSED [ 46%]
  640. 1166.77 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_batched_query_errors_have_clear_markers PASSED [ 47%]
  641. 1168.47 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMInitialization::test_tools_call_counter_is_thread_safe PASSED [ 47%]
  642. 1170.17 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```python\nprint(1)\n```-print(1)] PASSED [ 47%]
  643. 1171.86 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```py\nx = 1\nprint(x)\n```-x = 1\nprint(x)] PASSED [ 47%]
  644. 1173.51 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```\nprint('no lang')\n```-print('no lang')] PASSED [ 47%]
  645. 1175.15 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[not fenced code-not fenced code] PASSED [ 47%]
  646. 1176.80 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[I'll inspect first.\n```python\nprint('hello')\n```\nThen I will submit.-print('hello')] PASSED [ 47%]
  647. 1178.48 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```python\nprint(1)\n```\nsome trailing text-print(1)] PASSED [ 47%]
  648. 1180.24 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```python\nprint('oops')-print('oops')] PASSED [ 47%]
  649. 1181.96 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```\n```python\nprint(1)\n```\n```-print(1)] PASSED [ 47%]
  650. 1183.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences[```\n```\nprint(2)\n```\n```-print(2)] PASSED [ 47%]
  651. 1185.24 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCodeFenceParsing::test_strip_code_fences_rejects_non_python_lang PASSED [ 47%]
  652. 1186.86 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_history PASSED [ 47%]
  653. 1188.51 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_history_empty PASSED [ 48%]
  654. 1190.11 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_action_signature_has_iteration_field PASSED [ 48%]
  655. 1191.76 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_output PASSED [ 48%]
  656. 1193.42 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_output_empty PASSED [ 48%]
  657. 1194.99 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_output_passthrough PASSED [ 48%]
  658. 1196.78 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_variable_info_string PASSED [ 48%]
  659. 1198.45 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_format_variable_info_dict PASSED [ 48%]
  660. 1200.14 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMFormatting::test_build_variables_multiple PASSED [ 48%]
  661. 1201.96 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_history_immutability PASSED [ 48%]
  662. 1203.69 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_history_len_iter_bool PASSED [ 48%]
  663. 1205.30 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_entry_format PASSED [ 48%]
  664. 1207.01 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_entry_format_truncation PASSED [ 48%]
  665. 1208.71 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_entry_format_no_truncation PASSED [ 48%]
  666. 1210.44 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_history_threads_max_output_chars PASSED [ 49%]
  667. 1212.20 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_variable_from_value PASSED [ 49%]
  668. 1213.90 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_variable_truncation PASSED [ 49%]
  669. 1215.57 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_variable_with_field_info PASSED [ 49%]
  670. 1217.31 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_repl_variable_without_field_info PASSED [ 49%]
  671. 1219.07 s [dspy-pytest] tests/predict/test_rlm.py::TestREPLTypes::test_build_variables_includes_field_metadata PASSED [ 49%]
  672. 1220.74 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMCallMethod::test_call_is_alias_for_forward PASSED [ 49%]
  673. 1222.36 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMaxIterationsFallback::test_max_iters_triggers_extract PASSED [ 49%]
  674. 1224.02 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMToolExceptions::test_tool_exception_returns_error_in_output PASSED [ 49%]
  675. 1225.69 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMToolExceptions::test_runtime_error_history_uses_stripped_code PASSED [ 49%]
  676. 1227.39 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMToolExceptions::test_syntax_error_from_execute_is_recoverable PASSED [ 49%]
  677. 1229.14 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMToolExceptions::test_syntax_error_from_strip_code_fences_is_recoverable PASSED [ 49%]
  678. 1230.79 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMDynamicSignature::test_action_signature_structure PASSED [ 49%]
  679. 1232.52 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMDynamicSignature::test_extract_signature_structure PASSED [ 50%]
  680. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_start_prewarms_sandbox SKIPPED [ 50%]
  681. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_start_is_idempotent SKIPPED [ 50%]
  682. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_basic_execution SKIPPED [ 50%]
  683. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_variable_injection SKIPPED [ 50%]
  684. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_variable_injection_with_none_values SKIPPED [ 50%]
  685. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_tool_call_kwargs SKIPPED [ 50%]
  686. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_tool_call_positional SKIPPED [ 50%]
  687. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_multiple_tools SKIPPED [ 50%]
  688. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_tool_returns_list SKIPPED [ 50%]
  689. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_tool_returns_dict SKIPPED [ 50%]
  690. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_state_persists SKIPPED [ 50%]
  691. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_syntax_error SKIPPED [ 50%]
  692. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestPythonInterpreter::test_runtime_error SKIPPED [ 51%]
  693. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestSandboxSecurity::test_no_network_access SKIPPED [ 51%]
  694. 1232.54 s [dspy-pytest] tests/predict/test_rlm.py::TestSandboxSecurity::test_imports_work SKIPPED [ 51%]
  695. 1234.27 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMAsyncMock::test_aforward_basic PASSED [ 51%]
  696. 1235.99 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMAsyncMock::test_aforward_int_output_mock PASSED [ 51%]
  697. 1237.68 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMAsyncMock::test_aforward_multi_iteration_mock PASSED [ 51%]
  698. 1239.28 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_coercion[count-int-42-SUBMIT(42)-42] PASSED [ 51%]
  699. 1240.88 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_coercion[score-float-3.14-SUBMIT(3.14)-3.14] PASSED [ 51%]
  700. 1242.55 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_coercion[valid-bool-True-SUBMIT(True)-True] PASSED [ 51%]
  701. 1244.20 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_coercion[numbers-list[int]-final_value3-SUBMIT([1, 2, 3])-expected3] PASSED [ 51%]
  702. 1245.92 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_coercion[answer-Literal['yes', 'no']-yes-SUBMIT("yes")-yes] PASSED [ 51%]
  703. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercionMock::test_type_error_retries PASSED [ 51%]
  704. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[count-int-SUBMIT(42)-42-int] SKIPPED [ 51%]
  705. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[score-float-SUBMIT(3.14)-3.14-float] SKIPPED [ 52%]
  706. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[valid-bool-SUBMIT(True)-True-bool] SKIPPED [ 52%]
  707. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[numbers-list[int]-SUBMIT([1, 2, 3])-expected3-list] SKIPPED [ 52%]
  708. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[data-dict[str, str]-SUBMIT({"key": "value"})-expected4-dict] SKIPPED [ 52%]
  709. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_type_coercion[answer-Literal['yes', 'no']-SUBMIT("yes")-yes-str] SKIPPED [ 52%]
  710. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMTypeCoercion::test_submit_extracts_typed_value SKIPPED [ 52%]
  711. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_final_kwargs SKIPPED [ 52%]
  712. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_final_positional SKIPPED [ 52%]
  713. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_three_fields SKIPPED [ 52%]
  714. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_final_missing_field_errors SKIPPED [ 52%]
  715. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_submit_vars SKIPPED [ 52%]
  716. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMMultipleOutputs::test_multi_output_type_coercion SKIPPED [ 52%]
  717. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_simple_computation_e2e SKIPPED [ 52%]
  718. 1247.58 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_multi_turn_computation_e2e SKIPPED [ 53%]
  719. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_with_input_variables_e2e SKIPPED [ 53%]
  720. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_with_tool_e2e SKIPPED [ 53%]
  721. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_aforward_simple_computation_e2e SKIPPED [ 53%]
  722. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_aforward_multi_turn_e2e SKIPPED [ 53%]
  723. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMWithDummyLM::test_aforward_with_input_variables_e2e SKIPPED [ 53%]
  724. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMIntegration::test_simple_computation SKIPPED [ 53%]
  725. 1247.59 s [dspy-pytest] tests/predict/test_rlm.py::TestRLMIntegration::test_with_llm_query SKIPPED [ 53%]
  726. 1249.12 s [dspy-pytest] tests/predict/test_rlm.py::TestBuildVariablesWithSerializable::test_serializable_uses_build_repl_variable PASSED [ 53%]
  727. 1250.77 s [dspy-pytest] tests/predict/test_rlm.py::TestBuildVariablesWithSerializable::test_regular_values_unchanged PASSED [ 53%]
  728. 1252.47 s [dspy-pytest] tests/predict/test_rlm.py::TestPrepareSerializableVars::test_separates_serializable_from_regular PASSED [ 53%]
  729. 1254.16 s [dspy-pytest] tests/predict/test_rlm.py::TestPrepareSerializableVars::test_no_serializable_returns_all PASSED [ 53%]
  730. 1255.81 s [dspy-pytest] tests/predict/test_rlm.py::TestPrepareSerializableVars::test_binary_payload_uses_base64_transport PASSED [ 53%]
  731. 1257.38 s [dspy-pytest] tests/predict/test_rlm.py::TestPrepareSerializableVars::test_large_payload_not_inlined_in_code PASSED [ 53%]
  732. 1259.00 s [dspy-pytest] tests/predict/test_rlm.py::TestPrepareSerializableVars::test_forward_with_serializable PASSED [ 54%]
  733. 1259.00 s [dspy-pytest] tests/predict/test_rlm.py::TestLargeSerializableRoundTrip::test_large_payload_round_trips_through_real_sandbox SKIPPED [ 54%]
  734. 1260.63 s [dspy-pytest] tests/primitives/test_base_module.py::test_deepcopy_basic PASSED [ 54%]
  735. 1262.36 s [dspy-pytest] tests/primitives/test_base_module.py::test_deepcopy_with_uncopyable_modules PASSED [ 54%]
  736. 1264.09 s [dspy-pytest] tests/primitives/test_base_module.py::test_deepcopy_with_nested_modules PASSED [ 54%]
  737. 1265.82 s [dspy-pytest] tests/primitives/test_base_module.py::test_save_and_load_with_json PASSED [ 54%]
  738. 1265.82 s [dspy-pytest] tests/primitives/test_base_module.py::test_save_and_load_with_pkl SKIPPED [ 54%]
  739. 1267.58 s [dspy-pytest] tests/primitives/test_base_module.py::test_save_with_extra_modules PASSED [ 54%]
  740. 1269.33 s [dspy-pytest] tests/primitives/test_base_module.py::test_load_with_version_mismatch PASSED [ 54%]
  741. 1269.33 s [dspy-pytest] tests/primitives/test_base_module.py::test_single_module_call_with_usage_tracker SKIPPED [ 54%]
  742. 1269.33 s [dspy-pytest] tests/primitives/test_base_module.py::test_multi_module_call_with_usage_tracker SKIPPED [ 54%]
  743. 1269.33 s [dspy-pytest] tests/primitives/test_base_module.py::test_usage_tracker_in_parallel SKIPPED [ 54%]
  744. 1271.01 s [dspy-pytest] tests/primitives/test_base_module.py::test_usage_tracker_async_parallel PASSED [ 54%]
  745. 1272.77 s [dspy-pytest] tests/primitives/test_base_module.py::test_usage_tracker_no_side_effect PASSED [ 55%]
  746. 1274.50 s [dspy-pytest] tests/primitives/test_base_module.py::test_module_history PASSED [ 55%]
  747. 1276.20 s [dspy-pytest] tests/primitives/test_base_module.py::test_module_history_with_concurrency PASSED [ 55%]
  748. 1277.99 s [dspy-pytest] tests/primitives/test_base_module.py::test_module_history_async PASSED [ 55%]
  749. 1279.62 s [dspy-pytest] tests/primitives/test_base_module.py::test_forward_direct_call_warning PASSED [ 55%]
  750. 1281.27 s [dspy-pytest] tests/primitives/test_base_module.py::test_forward_through_call_no_warning PASSED [ 55%]
  751. 1283.02 s [dspy-pytest] tests/primitives/test_example.py::test_example_initialization PASSED [ 55%]
  752. 1284.75 s [dspy-pytest] tests/primitives/test_example.py::test_example_initialization_from_base PASSED [ 55%]
  753. 1286.44 s [dspy-pytest] tests/primitives/test_example.py::test_example_initialization_from_dict PASSED [ 55%]
  754. 1288.06 s [dspy-pytest] tests/primitives/test_example.py::test_example_set_get_item PASSED [ 55%]
  755. 1289.69 s [dspy-pytest] tests/primitives/test_example.py::test_example_attribute_access PASSED [ 55%]
  756. 1291.34 s [dspy-pytest] tests/primitives/test_example.py::test_example_deletion PASSED [ 55%]
  757. 1293.07 s [dspy-pytest] tests/primitives/test_example.py::test_example_len PASSED [ 55%]
  758. 1294.75 s [dspy-pytest] tests/primitives/test_example.py::test_example_repr_str_img PASSED [ 56%]
  759. 1296.41 s [dspy-pytest] tests/primitives/test_example.py::test_example_repr_str PASSED [ 56%]
  760. 1298.14 s [dspy-pytest] tests/primitives/test_example.py::test_example_eq PASSED [ 56%]
  761. 1299.88 s [dspy-pytest] tests/primitives/test_example.py::test_example_hash PASSED [ 56%]
  762. 1301.49 s [dspy-pytest] tests/primitives/test_example.py::test_example_keys_values_items PASSED [ 56%]
  763. 1303.13 s [dspy-pytest] tests/primitives/test_example.py::test_example_get PASSED [ 56%]
  764. 1304.84 s [dspy-pytest] tests/primitives/test_example.py::test_example_with_inputs PASSED [ 56%]
  765. 1306.61 s [dspy-pytest] tests/primitives/test_example.py::test_example_inputs_labels PASSED [ 56%]
  766. 1308.28 s [dspy-pytest] tests/primitives/test_example.py::test_example_copy_without PASSED [ 56%]
  767. 1309.95 s [dspy-pytest] tests/primitives/test_example.py::test_example_to_dict PASSED [ 56%]
  768. 1311.70 s [dspy-pytest] tests/primitives/test_example.py::test_example_to_dict_with_history PASSED [ 56%]
  769. 1313.49 s [dspy-pytest] tests/primitives/test_module.py::test_module_initialization PASSED [ 56%]
  770. 1315.02 s [dspy-pytest] tests/primitives/test_module.py::test_named_predictors PASSED [ 56%]
  771. 1316.73 s [dspy-pytest] tests/primitives/test_module.py::test_predictors PASSED [ 57%]
  772. 1318.43 s [dspy-pytest] tests/primitives/test_module.py::test_forward PASSED [ 57%]
  773. 1320.15 s [dspy-pytest] tests/primitives/test_module.py::test_nested_named_predictors PASSED [ 57%]
  774. 1321.79 s [dspy-pytest] tests/primitives/test_module.py::test_empty_module PASSED [ 57%]
  775. 1323.44 s [dspy-pytest] tests/primitives/test_module.py::test_single_level PASSED [ 57%]
  776. 1325.15 s [dspy-pytest] tests/primitives/test_module.py::test_multiple_levels PASSED [ 57%]
  777. 1326.89 s [dspy-pytest] tests/primitives/test_module.py::test_multiple_sub_modules PASSED [ 57%]
  778. 1328.52 s [dspy-pytest] tests/primitives/test_module.py::test_non_base_module_attributes PASSED [ 57%]
  779. 1330.19 s [dspy-pytest] tests/primitives/test_module.py::test_complex_module_traversal PASSED [ 57%]
  780. 1331.93 s [dspy-pytest] tests/primitives/test_module.py::test_complex_module_traversal_with_same_module PASSED [ 57%]
  781. 1333.73 s [dspy-pytest] tests/primitives/test_module.py::test_complex_module_set_attribute_by_name PASSED [ 57%]
  782. 1335.46 s [dspy-pytest] tests/primitives/test_module.py::test_named_parameters_duplicate_references PASSED [ 57%]
  783. 1337.14 s [dspy-pytest] tests/primitives/test_module.py::test_load_dspy_program_cross_version PASSED [ 57%]
  784. 1338.85 s [dspy-pytest] tests/primitives/test_module.py::test_load_state_is_transactional PASSED [ 58%]
  785. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_execute_simple_code SKIPPED [ 58%]
  786. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_import SKIPPED (need
  787. 1338.85 s [dspy-pytest] --deno option to run) [ 58%]
  788. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_user_variable_definitions SKIPPED [ 58%]
  789. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_rejects_python_keywords_as_variable_names SKIPPED [ 58%]
  790. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_failure_syntax_error SKIPPED [ 58%]
  791. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_failure_zero_division SKIPPED [ 58%]
  792. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_exception_args SKIPPED [ 58%]
  793. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_submit_with_list SKIPPED [ 58%]
  794. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_enable_env_vars_flag SKIPPED [ 58%]
  795. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_read_file_access_control SKIPPED [ 58%]
  796. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_enable_write_flag SKIPPED [ 58%]
  797. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_enable_net_flag SKIPPED [ 58%]
  798. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_interpreter_security_filesystem_access SKIPPED [ 59%]
  799. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tools_dict_is_copied SKIPPED [ 59%]
  800. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_serialize_tuple SKIPPED [ 59%]
  801. 1338.85 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_serialize_set SKIPPED [ 59%]
  802. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_serialize_set_mixed_types SKIPPED [ 59%]
  803. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_deno_command_dict_raises_type_error SKIPPED [ 59%]
  804. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_with_typed_signature SKIPPED [ 59%]
  805. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_positional_args SKIPPED [ 59%]
  806. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_keyword_args SKIPPED [ 59%]
  807. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_default_args SKIPPED [ 59%]
  808. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tools_re_register_after_process_restart SKIPPED [ 59%]
  809. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_mounts_replay_after_process_restart SKIPPED [ 59%]
  810. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_all_positional_args SKIPPED [ 59%]
  811. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_error_surfaces_as_runtime_error SKIPPED [ 60%]
  812. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_async_def_function SKIPPED [ 60%]
  813. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_tool_async_def_raises_propagates SKIPPED [ 60%]
  814. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_submit_with_typed_signature SKIPPED [ 60%]
  815. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_submit_positional_args SKIPPED [ 60%]
  816. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_submit_multi_output SKIPPED [ 60%]
  817. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_submit_wrong_arg_count SKIPPED [ 60%]
  818. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_extract_parameters SKIPPED [ 60%]
  819. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_extract_parameters_complex_types SKIPPED [ 60%]
  820. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_large_variable_injection SKIPPED [ 60%]
  821. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_large_variable_content_integrity SKIPPED [ 60%]
  822. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_mixed_small_and_large_variables SKIPPED [ 60%]
  823. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_multiple_large_variables SKIPPED [ 60%]
  824. 1338.86 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_large_list_variable SKIPPED [ 61%]
  825. 1338.87 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_nested_sets_and_tuples SKIPPED [ 61%]
  826. 1338.87 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_small_variable_not_using_filesystem SKIPPED [ 61%]
  827. 1338.87 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_large_variable_threshold_boundary SKIPPED [ 61%]
  828. 1338.87 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_enable_read_paths_symlink SKIPPED [ 61%]
  829. 1338.87 s [dspy-pytest] tests/primitives/test_python_interpreter.py::test_enable_read_paths_multiple_files SKIPPED [ 61%]
  830. 1340.61 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestABCConformance::test_subclass_conformance PASSED [ 61%]
  831. 1342.38 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestABCConformance::test_incomplete_subclass_cannot_instantiate PASSED [ 61%]
  832. 1344.33 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestABCConformance::test_structural_conformance_no_longer_accepted PASSED [ 61%]
  833. 1346.21 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestCoreMethods::test_sandbox_setup PASSED [ 61%]
  834. 1348.03 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestCoreMethods::test_to_sandbox_returns_bytes PASSED [ 61%]
  835. 1349.82 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestCoreMethods::test_sandbox_assignment PASSED [ 61%]
  836. 1351.67 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestCoreMethods::test_rlm_preview PASSED [ 61%]
  837. 1353.50 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestCoreMethods::test_rlm_preview_truncation PASSED [ 61%]
  838. 1355.31 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestBuildReplVariable::test_builds_variable_with_preview_from_rlm_preview PASSED [ 62%]
  839. 1357.14 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestBuildReplVariable::test_surfaces_sandbox_setup_in_description PASSED [ 62%]
  840. 1359.05 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestBuildReplVariable::test_passes_field_info_through PASSED [ 62%]
  841. 1360.91 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestToReplVariableMethod::test_default_to_repl_variable PASSED [ 62%]
  842. 1362.71 s [dspy-pytest] tests/primitives/test_sandbox_serializable.py::TestSignatureAnnotation::test_subclass_supports_signature_annotation PASSED [ 62%]
  843. 1364.50 s [dspy-pytest] tests/propose/test_grounded_proposer.py::test_propose_instructions_for_program[None] PASSED [ 62%]
  844. 1366.33 s [dspy-pytest] tests/propose/test_grounded_proposer.py::test_propose_instructions_for_program[demo_candidates1] PASSED [ 62%]
  845. 1368.07 s [dspy-pytest] tests/propose/test_grounded_proposer.py::test_propose_instruction_for_predictor[None] PASSED [ 62%]
  846. 1369.96 s [dspy-pytest] tests/propose/test_grounded_proposer.py::test_propose_instruction_for_predictor[demo_candidates1] PASSED [ 62%]
  847. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-input_formats-test_markdown_1-input1] SKIPPED [ 62%]
  848. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-input_formats-test_markdown_1-input2] SKIPPED [ 62%]
  849. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-complex_types-test_many_types_1-input1] SKIPPED [ 62%]
  850. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-complex_types-test_many_types_1-input2] SKIPPED [ 62%]
  851. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-complex_types-test_nesting_2-input1] SKIPPED [ 63%]
  852. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-complex_types-test_nesting_1-input1] SKIPPED [ 63%]
  853. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-complex_types-test_nesting_1-input2] SKIPPED [ 63%]
  854. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-input_formats-test_markdown_1-input1] SKIPPED [ 63%]
  855. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-input_formats-test_markdown_1-input2] SKIPPED [ 63%]
  856. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-complex_types-test_many_types_1-input1] SKIPPED [ 63%]
  857. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-complex_types-test_many_types_1-input2] SKIPPED [ 63%]
  858. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-complex_types-test_nesting_2-input1] SKIPPED [ 63%]
  859. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-complex_types-test_nesting_1-input1] SKIPPED [ 63%]
  860. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4o-mini-complex_types-test_nesting_1-input2] SKIPPED [ 63%]
  861. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-input_formats-test_markdown_1-input1] SKIPPED [ 63%]
  862. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-input_formats-test_markdown_1-input2] SKIPPED [ 63%]
  863. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-complex_types-test_many_types_1-input1] SKIPPED [ 63%]
  864. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-complex_types-test_many_types_1-input2] SKIPPED [ 64%]
  865. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-complex_types-test_nesting_2-input1] SKIPPED [ 64%]
  866. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-complex_types-test_nesting_1-input1] SKIPPED [ 64%]
  867. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-4-turbo-complex_types-test_nesting_1-input2] SKIPPED [ 64%]
  868. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-input_formats-test_markdown_1-input1] SKIPPED [ 64%]
  869. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-input_formats-test_markdown_1-input2] SKIPPED [ 64%]
  870. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-complex_types-test_many_types_1-input1] SKIPPED [ 64%]
  871. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-complex_types-test_many_types_1-input2] SKIPPED [ 64%]
  872. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-complex_types-test_nesting_2-input1] SKIPPED [ 64%]
  873. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-complex_types-test_nesting_1-input1] SKIPPED [ 64%]
  874. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-preview-complex_types-test_nesting_1-input2] SKIPPED [ 64%]
  875. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-input_formats-test_markdown_1-input1] SKIPPED [ 64%]
  876. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-input_formats-test_markdown_1-input2] SKIPPED [ 64%]
  877. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-complex_types-test_many_types_1-input1] SKIPPED [ 65%]
  878. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-complex_types-test_many_types_1-input2] SKIPPED [ 65%]
  879. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-complex_types-test_nesting_2-input1] SKIPPED [ 65%]
  880. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-complex_types-test_nesting_1-input1] SKIPPED [ 65%]
  881. 1369.98 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gpt-o1-mini-complex_types-test_nesting_1-input2] SKIPPED [ 65%]
  882. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-input_formats-test_markdown_1-input1] SKIPPED [ 65%]
  883. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-input_formats-test_markdown_1-input2] SKIPPED [ 65%]
  884. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-complex_types-test_many_types_1-input1] SKIPPED [ 65%]
  885. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-complex_types-test_many_types_1-input2] SKIPPED [ 65%]
  886. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-complex_types-test_nesting_2-input1] SKIPPED [ 65%]
  887. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-complex_types-test_nesting_1-input1] SKIPPED [ 65%]
  888. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-sonnet-complex_types-test_nesting_1-input2] SKIPPED [ 65%]
  889. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-input_formats-test_markdown_1-input1] SKIPPED [ 65%]
  890. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-input_formats-test_markdown_1-input2] SKIPPED [ 66%]
  891. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-complex_types-test_many_types_1-input1] SKIPPED [ 66%]
  892. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-complex_types-test_many_types_1-input2] SKIPPED [ 66%]
  893. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-complex_types-test_nesting_2-input1] SKIPPED [ 66%]
  894. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-complex_types-test_nesting_1-input1] SKIPPED [ 66%]
  895. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[claude-3.5-haiku-complex_types-test_nesting_1-input2] SKIPPED [ 66%]
  896. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-input_formats-test_markdown_1-input1] SKIPPED [ 66%]
  897. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-input_formats-test_markdown_1-input2] SKIPPED [ 66%]
  898. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-complex_types-test_many_types_1-input1] SKIPPED [ 66%]
  899. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-complex_types-test_many_types_1-input2] SKIPPED [ 66%]
  900. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-complex_types-test_nesting_2-input1] SKIPPED [ 66%]
  901. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-complex_types-test_nesting_1-input1] SKIPPED [ 66%]
  902. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-pro-complex_types-test_nesting_1-input2] SKIPPED [ 66%]
  903. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-input_formats-test_markdown_1-input1] SKIPPED [ 67%]
  904. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-input_formats-test_markdown_1-input2] SKIPPED [ 67%]
  905. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-complex_types-test_many_types_1-input1] SKIPPED [ 67%]
  906. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-complex_types-test_many_types_1-input2] SKIPPED [ 67%]
  907. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-complex_types-test_nesting_2-input1] SKIPPED [ 67%]
  908. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-complex_types-test_nesting_1-input1] SKIPPED [ 67%]
  909. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[gemini-1.5-flash-complex_types-test_nesting_1-input2] SKIPPED [ 67%]
  910. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-input_formats-test_markdown_1-input1] SKIPPED [ 67%]
  911. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-input_formats-test_markdown_1-input2] SKIPPED [ 67%]
  912. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-complex_types-test_many_types_1-input1] SKIPPED [ 67%]
  913. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-complex_types-test_many_types_1-input2] SKIPPED [ 67%]
  914. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-complex_types-test_nesting_2-input1] SKIPPED [ 67%]
  915. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-complex_types-test_nesting_1-input1] SKIPPED [ 67%]
  916. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-405b-instruct-complex_types-test_nesting_1-input2] SKIPPED [ 68%]
  917. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-input_formats-test_markdown_1-input1] SKIPPED [ 68%]
  918. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-input_formats-test_markdown_1-input2] SKIPPED [ 68%]
  919. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-complex_types-test_many_types_1-input1] SKIPPED [ 68%]
  920. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-complex_types-test_many_types_1-input2] SKIPPED [ 68%]
  921. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-complex_types-test_nesting_2-input1] SKIPPED [ 68%]
  922. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-complex_types-test_nesting_1-input1] SKIPPED [ 68%]
  923. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-70b-instruct-complex_types-test_nesting_1-input2] SKIPPED [ 68%]
  924. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-input_formats-test_markdown_1-input1] SKIPPED [ 68%]
  925. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-input_formats-test_markdown_1-input2] SKIPPED [ 68%]
  926. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-complex_types-test_many_types_1-input1] SKIPPED [ 68%]
  927. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-complex_types-test_many_types_1-input2] SKIPPED [ 68%]
  928. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-complex_types-test_nesting_2-input1] SKIPPED [ 68%]
  929. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-complex_types-test_nesting_1-input1] SKIPPED [ 69%]
  930. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.1-8b-instruct-complex_types-test_nesting_1-input2] SKIPPED [ 69%]
  931. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-input_formats-test_markdown_1-input1] SKIPPED [ 69%]
  932. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-input_formats-test_markdown_1-input2] SKIPPED [ 69%]
  933. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-complex_types-test_many_types_1-input1] SKIPPED [ 69%]
  934. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-complex_types-test_many_types_1-input2] SKIPPED [ 69%]
  935. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-complex_types-test_nesting_2-input1] SKIPPED [ 69%]
  936. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-complex_types-test_nesting_1-input1] SKIPPED [ 69%]
  937. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[llama-3.2-3b-instruct-complex_types-test_nesting_1-input2] SKIPPED [ 69%]
  938. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-input_formats-test_markdown_1-input1] SKIPPED [ 69%]
  939. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-input_formats-test_markdown_1-input2] SKIPPED [ 69%]
  940. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-complex_types-test_many_types_1-input1] SKIPPED [ 69%]
  941. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-complex_types-test_many_types_1-input2] SKIPPED [ 69%]
  942. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-complex_types-test_nesting_2-input1] SKIPPED [ 69%]
  943. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-complex_types-test_nesting_1-input1] SKIPPED [ 70%]
  944. 1370.12 s [dspy-pytest] tests/reliability/test_generated.py::test_generated_cases[deepseek-r1-complex_types-test_nesting_1-input2] SKIPPED [ 70%]
  945. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gpt-4o] SKIPPED [ 70%]
  946. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gpt-4o-mini] SKIPPED [ 70%]
  947. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gpt-4-turbo] SKIPPED [ 70%]
  948. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gpt-o1-preview] SKIPPED [ 70%]
  949. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gpt-o1-mini] SKIPPED [ 70%]
  950. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[claude-3.5-sonnet] SKIPPED [ 70%]
  951. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[claude-3.5-haiku] SKIPPED [ 70%]
  952. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gemini-1.5-pro] SKIPPED [ 70%]
  953. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[gemini-1.5-flash] SKIPPED [ 70%]
  954. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[llama-3.1-405b-instruct] SKIPPED [ 70%]
  955. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[llama-3.1-70b-instruct] SKIPPED [ 70%]
  956. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[llama-3.1-8b-instruct] SKIPPED [ 71%]
  957. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[llama-3.2-3b-instruct] SKIPPED [ 71%]
  958. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_qa_with_pydantic_answer_model[deepseek-r1] SKIPPED [ 71%]
  959. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4o-Predict] SKIPPED [ 71%]
  960. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4o-ChainOfThought] SKIPPED [ 71%]
  961. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4o-mini-Predict] SKIPPED [ 71%]
  962. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4o-mini-ChainOfThought] SKIPPED [ 71%]
  963. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4-turbo-Predict] SKIPPED [ 71%]
  964. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-4-turbo-ChainOfThought] SKIPPED [ 71%]
  965. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-o1-preview-Predict] SKIPPED [ 71%]
  966. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-o1-preview-ChainOfThought] SKIPPED [ 71%]
  967. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-o1-mini-Predict] SKIPPED [ 71%]
  968. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gpt-o1-mini-ChainOfThought] SKIPPED [ 71%]
  969. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[claude-3.5-sonnet-Predict] SKIPPED [ 72%]
  970. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[claude-3.5-sonnet-ChainOfThought] SKIPPED [ 72%]
  971. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[claude-3.5-haiku-Predict] SKIPPED [ 72%]
  972. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[claude-3.5-haiku-ChainOfThought] SKIPPED [ 72%]
  973. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gemini-1.5-pro-Predict] SKIPPED [ 72%]
  974. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gemini-1.5-pro-ChainOfThought] SKIPPED [ 72%]
  975. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gemini-1.5-flash-Predict] SKIPPED [ 72%]
  976. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[gemini-1.5-flash-ChainOfThought] SKIPPED [ 72%]
  977. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-405b-instruct-Predict] SKIPPED [ 72%]
  978. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-405b-instruct-ChainOfThought] SKIPPED [ 72%]
  979. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-70b-instruct-Predict] SKIPPED [ 72%]
  980. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-70b-instruct-ChainOfThought] SKIPPED [ 72%]
  981. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-8b-instruct-Predict] SKIPPED [ 72%]
  982. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.1-8b-instruct-ChainOfThought] SKIPPED [ 73%]
  983. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.2-3b-instruct-Predict] SKIPPED [ 73%]
  984. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[llama-3.2-3b-instruct-ChainOfThought] SKIPPED [ 73%]
  985. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[deepseek-r1-Predict] SKIPPED [ 73%]
  986. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_color_classification_using_enum[deepseek-r1-ChainOfThought] SKIPPED [ 73%]
  987. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gpt-4o] SKIPPED [ 73%]
  988. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gpt-4o-mini] SKIPPED [ 73%]
  989. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gpt-4-turbo] SKIPPED [ 73%]
  990. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gpt-o1-preview] SKIPPED [ 73%]
  991. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gpt-o1-mini] SKIPPED [ 73%]
  992. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[claude-3.5-sonnet] SKIPPED [ 73%]
  993. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[claude-3.5-haiku] SKIPPED [ 73%]
  994. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gemini-1.5-pro] SKIPPED [ 73%]
  995. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[gemini-1.5-flash] SKIPPED [ 74%]
  996. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[llama-3.1-405b-instruct] SKIPPED [ 74%]
  997. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[llama-3.1-70b-instruct] SKIPPED [ 74%]
  998. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[llama-3.1-8b-instruct] SKIPPED [ 74%]
  999. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[llama-3.2-3b-instruct] SKIPPED [ 74%]
  1000. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_entity_extraction_with_multiple_primitive_outputs[deepseek-r1] SKIPPED [ 74%]
  1001. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4o-Predict] SKIPPED [ 74%]
  1002. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4o-ChainOfThought] SKIPPED [ 74%]
  1003. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4o-mini-Predict] SKIPPED [ 74%]
  1004. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4o-mini-ChainOfThought] SKIPPED [ 74%]
  1005. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4-turbo-Predict] SKIPPED [ 74%]
  1006. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-4-turbo-ChainOfThought] SKIPPED [ 74%]
  1007. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-o1-preview-Predict] SKIPPED [ 74%]
  1008. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-o1-preview-ChainOfThought] SKIPPED [ 75%]
  1009. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-o1-mini-Predict] SKIPPED [ 75%]
  1010. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gpt-o1-mini-ChainOfThought] SKIPPED [ 75%]
  1011. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[claude-3.5-sonnet-Predict] SKIPPED [ 75%]
  1012. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[claude-3.5-sonnet-ChainOfThought] SKIPPED [ 75%]
  1013. 1370.12 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[claude-3.5-haiku-Predict] SKIPPED [ 75%]
  1014. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[claude-3.5-haiku-ChainOfThought] SKIPPED [ 75%]
  1015. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gemini-1.5-pro-Predict] SKIPPED [ 75%]
  1016. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gemini-1.5-pro-ChainOfThought] SKIPPED [ 75%]
  1017. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gemini-1.5-flash-Predict] SKIPPED [ 75%]
  1018. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[gemini-1.5-flash-ChainOfThought] SKIPPED [ 75%]
  1019. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-405b-instruct-Predict] SKIPPED [ 75%]
  1020. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-405b-instruct-ChainOfThought] SKIPPED [ 75%]
  1021. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-70b-instruct-Predict] SKIPPED [ 76%]
  1022. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-70b-instruct-ChainOfThought] SKIPPED [ 76%]
  1023. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-8b-instruct-Predict] SKIPPED [ 76%]
  1024. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.1-8b-instruct-ChainOfThought] SKIPPED [ 76%]
  1025. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.2-3b-instruct-Predict] SKIPPED [ 76%]
  1026. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[llama-3.2-3b-instruct-ChainOfThought] SKIPPED [ 76%]
  1027. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[deepseek-r1-Predict] SKIPPED [ 76%]
  1028. 1370.35 s [dspy-pytest] tests/reliability/test_pydantic_models.py::test_tool_calling_with_literals[deepseek-r1-ChainOfThought] SKIPPED [ 76%]
  1029. 1371.91 s [dspy-pytest] tests/retrievers/test_colbertv2.py::test_get_request_raises_on_server_error PASSED [ 76%]
  1030. 1373.74 s [dspy-pytest] tests/retrievers/test_colbertv2.py::test_post_request_raises_on_server_error PASSED [ 76%]
  1031. 1375.55 s [dspy-pytest] tests/retrievers/test_colbertv2.py::test_get_request_success PASSED [ 76%]
  1032. 1377.23 s [dspy-pytest] tests/retrievers/test_colbertv2.py::test_post_request_success PASSED [ 76%]
  1033. 1379.02 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_basic_search PASSED [ 76%]
  1034. 1381.08 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_multithreaded_search PASSED [ 76%]
  1035. 1383.04 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_save_load PASSED [ 77%]
  1036. 1384.80 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_from_saved PASSED [ 77%]
  1037. 1386.53 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_load_nonexistent_path PASSED [ 77%]
  1038. 1388.31 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_with_scores_basic_search PASSED [ 77%]
  1039. 1390.26 s [dspy-pytest] tests/retrievers/test_embeddings.py::test_embeddings_with_scores_save_load PASSED [ 77%]
  1040. 1392.74 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_local_path PASSED [ 77%]
  1041. 1395.24 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_path_method PASSED [ 77%]
  1042. 1397.84 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_path_with_custom_filename PASSED [ 77%]
  1043. 1400.44 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_bytes PASSED [ 77%]
  1044. 1403.22 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_bytes_with_filename PASSED [ 77%]
  1045. 1405.87 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_file_id PASSED [ 77%]
  1046. 1408.69 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_file_id_with_filename PASSED [ 77%]
  1047. 1410.69 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_dict_with_file_data PASSED [ 77%]
  1048. 1412.74 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_dict_with_file_id PASSED [ 78%]
  1049. 1414.87 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_format_with_file_data PASSED [ 78%]
  1050. 1416.88 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_format_with_file_id PASSED [ 78%]
  1051. 1418.38 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_repr_with_file_data PASSED [ 78%]
  1052. 1420.01 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_repr_with_file_id PASSED [ 78%]
  1053. 1421.54 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_str PASSED [ 78%]
  1054. 1423.57 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_encode_file_to_dict_from_path PASSED [ 78%]
  1055. 1425.61 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_encode_file_to_dict_from_bytes PASSED [ 78%]
  1056. 1427.73 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_invalid_file_string PASSED [ 78%]
  1057. 1429.65 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_invalid_dict PASSED [ 78%]
  1058. 1431.11 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_in_signature PASSED [ 78%]
  1059. 1432.56 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_list_in_signature PASSED [ 78%]
  1060. 1433.95 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_optional_file_field PASSED [ 78%]
  1061. 1435.71 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_save_load_file_signature PASSED [ 79%]
  1062. 1437.05 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_frozen PASSED [ 79%]
  1063. 1438.62 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_with_all_fields PASSED [ 79%]
  1064. 1440.59 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_path_not_found PASSED [ 79%]
  1065. 1441.94 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_custom_mime_type PASSED [ 79%]
  1066. 1443.43 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_from_bytes_custom_mime PASSED [ 79%]
  1067. 1445.32 s [dspy-pytest] tests/signatures/test_adapter_file.py::test_file_data_uri_in_format PASSED [ 79%]
  1068. 1447.04 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_basic_image_operations[test_case0] PASSED [ 79%]
  1069. 1448.73 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_basic_image_operations[test_case1] PASSED [ 79%]
  1070. 1450.47 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_basic_image_operations[test_case2] PASSED [ 79%]
  1071. 1452.65 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_basic_image_operations[test_case3] PASSED [ 79%]
  1072. 1455.17 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_save_load_complex_default_types PASSED [ 79%]
  1073. 1457.62 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_save_load_complex_types[test_case0] PASSED [ 79%]
  1074. 1460.00 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_save_load_complex_types[test_case1] PASSED [ 80%]
  1075. 1462.47 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_save_load_pydantic_model PASSED [ 80%]
  1076. 1465.00 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_optional_image_field PASSED [ 80%]
  1077. 1467.55 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_image_repr PASSED [ 80%]
  1078. 1470.02 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_from_methods_warn PASSED [ 80%]
  1079. 1471.70 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_invalid_string_format PASSED [ 80%]
  1080. 1473.35 s [dspy-pytest] tests/signatures/test_adapter_image.py::test_pil_image_with_download_parameter PASSED [ 80%]
  1081. 1475.12 s [dspy-pytest] tests/signatures/test_custom_types.py::test_basic_custom_type_resolution PASSED [ 80%]
  1082. 1476.88 s [dspy-pytest] tests/signatures/test_custom_types.py::test_type_alias_for_nested_types PASSED [ 80%]
  1083. 1478.62 s [dspy-pytest] tests/signatures/test_custom_types.py::test_module_level_type_resolution PASSED [ 80%]
  1084. 1480.40 s [dspy-pytest] tests/signatures/test_custom_types.py::test_recommended_patterns PASSED [ 80%]
  1085. 1481.96 s [dspy-pytest] tests/signatures/test_custom_types.py::test_expected_failure PASSED [ 80%]
  1086. 1483.66 s [dspy-pytest] tests/signatures/test_custom_types.py::test_module_type_resolution PASSED [ 80%]
  1087. 1485.43 s [dspy-pytest] tests/signatures/test_signature.py::test_field_types_and_custom_attributes PASSED [ 81%]
  1088. 1487.25 s [dspy-pytest] tests/signatures/test_signature.py::test_no_input_output PASSED [ 81%]
  1089. 1489.01 s [dspy-pytest] tests/signatures/test_signature.py::test_no_input_output2 PASSED [ 81%]
  1090. 1490.82 s [dspy-pytest] tests/signatures/test_signature.py::test_all_fields_have_prefix PASSED [ 81%]
  1091. 1492.51 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_parsing PASSED [ 81%]
  1092. 1494.17 s [dspy-pytest] tests/signatures/test_signature.py::test_duplicate_input_output_field_names_raise PASSED [ 81%]
  1093. 1495.97 s [dspy-pytest] tests/signatures/test_signature.py::test_with_signature PASSED [ 81%]
  1094. 1497.79 s [dspy-pytest] tests/signatures/test_signature.py::test_append_instructions PASSED [ 81%]
  1095. 1499.61 s [dspy-pytest] tests/signatures/test_signature.py::test_append_instructions_chains PASSED [ 81%]
  1096. 1501.41 s [dspy-pytest] tests/signatures/test_signature.py::test_append_instructions_preserves_default_instructions PASSED [ 81%]
  1097. 1503.13 s [dspy-pytest] tests/signatures/test_signature.py::test_with_updated_field PASSED [ 81%]
  1098. 1505.04 s [dspy-pytest] tests/signatures/test_signature.py::test_empty_signature PASSED [ 81%]
  1099. 1507.01 s [dspy-pytest] tests/signatures/test_signature.py::test_instructions_signature PASSED [ 81%]
  1100. 1509.48 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_instructions PASSED [ 82%]
  1101. 1512.20 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_instructions_none PASSED [ 82%]
  1102. 1515.00 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_from_dict PASSED [ 82%]
  1103. 1517.80 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_equality PASSED [ 82%]
  1104. 1520.78 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_inequality PASSED [ 82%]
  1105. 1523.63 s [dspy-pytest] tests/signatures/test_signature.py::test_equality_format PASSED [ 82%]
  1106. 1526.45 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_reverse PASSED [ 82%]
  1107. 1529.07 s [dspy-pytest] tests/signatures/test_signature.py::test_insert_field_at_various_positions PASSED [ 82%]
  1108. 1531.17 s [dspy-pytest] tests/signatures/test_signature.py::test_order_preserved_with_mixed_annotations PASSED [ 82%]
  1109. 1533.39 s [dspy-pytest] tests/signatures/test_signature.py::test_infer_prefix PASSED [ 82%]
  1110. 1535.62 s [dspy-pytest] tests/signatures/test_signature.py::test_insantiating PASSED [ 82%]
  1111. 1537.69 s [dspy-pytest] tests/signatures/test_signature.py::test_insantiating2 PASSED [ 82%]
  1112. 1539.78 s [dspy-pytest] tests/signatures/test_signature.py::test_multiline_instructions PASSED [ 82%]
  1113. 1541.75 s [dspy-pytest] tests/signatures/test_signature.py::test_dump_and_load_state PASSED [ 83%]
  1114. 1543.85 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_basic_types PASSED [ 83%]
  1115. 1545.95 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_generics PASSED [ 83%]
  1116. 1547.98 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_unions_and_optionals PASSED [ 83%]
  1117. 1549.93 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_any PASSED [ 83%]
  1118. 1551.70 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_nested PASSED [ 83%]
  1119. 1553.54 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_from_dict PASSED [ 83%]
  1120. 1555.42 s [dspy-pytest] tests/signatures/test_signature.py::test_typed_signatures_complex_combinations PASSED [ 83%]
  1121. 1557.25 s [dspy-pytest] tests/signatures/test_signature.py::test_make_signature_from_string PASSED [ 83%]
  1122. 1559.12 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_field_with_constraints PASSED [ 83%]
  1123. 1561.02 s [dspy-pytest] tests/signatures/test_signature.py::test_basic_custom_type PASSED [ 83%]
  1124. 1562.81 s [dspy-pytest] tests/signatures/test_signature.py::test_custom_type_from_different_module PASSED [ 83%]
  1125. 1564.61 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_inline PASSED [ 83%]
  1126. 1566.58 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_inline_equivalence PASSED [ 84%]
  1127. 1568.31 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_inline_nested PASSED [ 84%]
  1128. 1570.29 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_class_nested PASSED [ 84%]
  1129. 1572.16 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_class_equivalence PASSED [ 84%]
  1130. 1573.93 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_insert PASSED [ 84%]
  1131. 1575.76 s [dspy-pytest] tests/signatures/test_signature.py::test_pep604_union_type_with_custom_types PASSED [ 84%]
  1132. 1578.11 s [dspy-pytest] tests/signatures/test_signature.py::test_signature_cloudpickle_roundtrip PASSED [ 84%]
  1133. 1580.63 s [dspy-pytest] tests/signatures/test_signature.py::test_predict_cloudpickle_roundtrip PASSED [ 84%]
  1134. 1585.97 s [dspy-pytest] tests/streaming/test_streaming.py::test_streamify_yields_expected_response_chunks PASSED [ 84%]
  1135. 1591.35 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_response_yields_expected_response_chunks PASSED [ 84%]
  1136. 1593.96 s [dspy-pytest] tests/streaming/test_streaming.py::test_default_status_streaming PASSED [ 84%]
  1137. 1596.51 s [dspy-pytest] tests/streaming/test_streaming.py::test_custom_status_streaming PASSED [ 84%]
  1138. 1598.83 s [dspy-pytest] tests/streaming/test_streaming.py::test_concurrent_status_message_providers PASSED [ 84%]
  1139. 1598.83 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_chat_adapter SKIPPED [ 84%]
  1140. 1600.76 s [dspy-pytest] tests/streaming/test_streaming.py::test_default_status_streaming_in_async_program PASSED [ 85%]
  1141. 1600.76 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_json_adapter SKIPPED [ 85%]
  1142. 1603.10 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_handles_space_correctly PASSED [ 85%]
  1143. 1603.12 s [dspy-pytest] tests/streaming/test_streaming.py::test_sync_streaming SKIPPED (need
  1144. 1603.12 s [dspy-pytest] --llm_call option to run) [ 85%]
  1145. 1605.14 s [dspy-pytest] tests/streaming/test_streaming.py::test_sync_status_streaming PASSED [ 85%]
  1146. 1607.16 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_returns_correct_chunk_chat_adapter PASSED [ 85%]
  1147. 1609.25 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_returns_correct_chunk_json_adapter PASSED [ 85%]
  1148. 1611.30 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_returns_correct_chunk_chat_adapter_untokenized_stream PASSED [ 85%]
  1149. 1613.40 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_missing_completion_marker_chat_adapter PASSED [ 85%]
  1150. 1615.44 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_returns_correct_chunk_json_adapter_untokenized_stream PASSED [ 85%]
  1151. 1618.42 s [dspy-pytest] tests/streaming/test_streaming.py::test_status_message_non_blocking PASSED [ 85%]
  1152. 1621.27 s [dspy-pytest] tests/streaming/test_streaming.py::test_status_message_non_blocking_async_program PASSED [ 85%]
  1153. 1623.22 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_allow_reuse PASSED [ 85%]
  1154. 1625.31 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_returns_correct_chunk_xml_adapter PASSED [ 86%]
  1155. 1627.14 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_allows_custom_chunk_types PASSED [ 86%]
  1156. 1628.98 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_allows_custom_streamable_type PASSED [ 86%]
  1157. 1630.83 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_with_citations PASSED [ 86%]
  1158. 1632.57 s [dspy-pytest] tests/streaming/test_streaming.py::test_chat_adapter_simple_pydantic_streaming PASSED [ 86%]
  1159. 1634.36 s [dspy-pytest] tests/streaming/test_streaming.py::test_chat_adapter_with_generic_type_annotation PASSED [ 86%]
  1160. 1636.26 s [dspy-pytest] tests/streaming/test_streaming.py::test_chat_adapter_nested_pydantic_streaming PASSED [ 86%]
  1161. 1638.15 s [dspy-pytest] tests/streaming/test_streaming.py::test_chat_adapter_mixed_fields_streaming PASSED [ 86%]
  1162. 1639.94 s [dspy-pytest] tests/streaming/test_streaming.py::test_json_adapter_simple_pydantic_streaming PASSED [ 86%]
  1163. 1641.80 s [dspy-pytest] tests/streaming/test_streaming.py::test_json_adapter_bracket_balance_detection PASSED [ 86%]
  1164. 1643.45 s [dspy-pytest] tests/streaming/test_streaming.py::test_json_adapter_multiple_fields_detection PASSED [ 86%]
  1165. 1645.22 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_could_form_end_identifier_chat_adapter PASSED [ 86%]
  1166. 1646.93 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_could_form_end_identifier_json_adapter PASSED [ 86%]
  1167. 1648.57 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_could_form_end_identifier_xml_adapter PASSED [ 87%]
  1168. 1650.27 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_reasoning_model PASSED [ 87%]
  1169. 1652.08 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_empty_last_chunk_chat_adapter PASSED [ 87%]
  1170. 1653.84 s [dspy-pytest] tests/streaming/test_streaming.py::test_stream_listener_empty_last_chunk_json_adapter PASSED [ 87%]
  1171. 1655.67 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_reasoning_fallback PASSED [ 87%]
  1172. 1657.45 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_bettertogether_import PASSED [ 87%]
  1173. 1659.18 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_bettertogether_initialization_default PASSED [ 87%]
  1174. 1660.95 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_bettertogether_initialization_custom PASSED [ 87%]
  1175. 1662.72 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_bettertogether_initialization_invalid_optimizer PASSED [ 87%]
  1176. 1664.43 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_strategy_validation PASSED [ 87%]
  1177. 1666.15 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_compile_basic PASSED [ 87%]
  1178. 1667.96 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_trainset_validation PASSED [ 87%]
  1179. 1669.72 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_valset_ratio_validation PASSED [ 87%]
  1180. 1671.33 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_optimizer_compile_args_validation PASSED [ 88%]
  1181. 1672.99 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_student_in_optimizer_compile_args PASSED [ 88%]
  1182. 1674.74 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_compile_args_passed_to_optimizer PASSED [ 88%]
  1183. 1676.48 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_compile_args_multi_optimizer_strategy PASSED [ 88%]
  1184. 1678.17 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_compile_args_override_global_params PASSED [ 88%]
  1185. 1680.13 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_trainset_shuffling_between_steps PASSED [ 88%]
  1186. 1682.06 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_strategy_execution_order PASSED [ 88%]
  1187. 1684.05 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_lm_lifecycle_management PASSED [ 88%]
  1188. 1686.16 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_error_handling_returns_best_program PASSED [ 88%]
  1189. 1688.22 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_program_selection[test_valset0-p_optimized-With valset: returns best score (p), not latest (w)] PASSED [ 88%]
  1190. 1690.23 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_program_selection[None-w_optimized-Without valset: returns latest program (w)] PASSED [ 88%]
  1191. 1692.33 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_candidate_programs_structure PASSED [ 88%]
  1192. 1694.39 s [dspy-pytest] tests/teleprompt/test_bettertogether.py::test_empty_valset_handling PASSED [ 88%]
  1193. 1696.54 s [dspy-pytest] tests/teleprompt/test_bootstrap.py::test_bootstrap_initialization PASSED [ 89%]
  1194. 1698.61 s [dspy-pytest] tests/teleprompt/test_bootstrap.py::test_compile_with_predict_instances PASSED [ 89%]
  1195. 1700.72 s [dspy-pytest] tests/teleprompt/test_bootstrap.py::test_bootstrap_effectiveness PASSED [ 89%]
  1196. 1702.92 s [dspy-pytest] tests/teleprompt/test_bootstrap.py::test_error_handling_during_bootstrap PASSED [ 89%]
  1197. 1704.95 s [dspy-pytest] tests/teleprompt/test_bootstrap.py::test_validation_set_usage PASSED [ 89%]
  1198. 1707.08 s [dspy-pytest] tests/teleprompt/test_bootstrap_finetune.py::test_bootstrap_finetune_initialization PASSED [ 89%]
  1199. 1709.23 s [dspy-pytest] tests/teleprompt/test_bootstrap_finetune.py::test_compile_with_predict_instances PASSED [ 89%]
  1200. 1711.09 s [dspy-pytest] tests/teleprompt/test_bootstrap_finetune.py::test_error_handling_missing_lm PASSED [ 89%]
  1201. 1712.95 s [dspy-pytest] tests/teleprompt/test_bootstrap_trace.py::test_bootstrap_trace_data PASSED [ 89%]
  1202. 1714.85 s [dspy-pytest] tests/teleprompt/test_bootstrap_trace.py::test_bootstrap_trace_data_passes_callback_metadata PASSED [ 89%]
  1203. 1716.59 s [dspy-pytest] tests/teleprompt/test_copro_optimizer.py::test_signature_optimizer_initialization PASSED [ 89%]
  1204. 1718.43 s [dspy-pytest] tests/teleprompt/test_copro_optimizer.py::test_signature_optimizer_optimization_process PASSED [ 89%]
  1205. 1720.29 s [dspy-pytest] tests/teleprompt/test_copro_optimizer.py::test_signature_optimizer_statistics_tracking PASSED [ 89%]
  1206. 1722.13 s [dspy-pytest] tests/teleprompt/test_copro_optimizer.py::test_optimization_and_output_verification PASSED [ 90%]
  1207. 1723.89 s [dspy-pytest] tests/teleprompt/test_copro_optimizer.py::test_statistics_tracking_during_optimization PASSED [ 90%]
  1208. 1725.67 s [dspy-pytest] tests/teleprompt/test_ensemble.py::test_ensemble_without_reduction PASSED [ 90%]
  1209. 1727.48 s [dspy-pytest] tests/teleprompt/test_ensemble.py::test_ensemble_with_reduction PASSED [ 90%]
  1210. 1729.31 s [dspy-pytest] tests/teleprompt/test_ensemble.py::test_ensemble_with_size_limitation PASSED [ 90%]
  1211. 1731.08 s [dspy-pytest] tests/teleprompt/test_ensemble.py::test_ensemble_deterministic_behavior PASSED [ 90%]
  1212. 1732.87 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_gepa_adapter_disables_logging_on_minibatch_eval[None-batch0-expected_callback_metadata0] PASSED [ 90%]
  1213. 1734.57 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_gepa_adapter_disables_logging_on_minibatch_eval[None-batch1-expected_callback_metadata1] PASSED [ 90%]
  1214. 1736.23 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_gepa_adapter_disables_logging_on_minibatch_eval[1-batch2-expected_callback_metadata2] PASSED [ 90%]
  1215. 1737.91 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_gepa_adapter_disables_logging_on_minibatch_eval[1-batch3-expected_callback_metadata3] PASSED [ 90%]
  1216. 1739.70 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_basic_workflow[True] PASSED [ 90%]
  1217. 1741.47 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_basic_workflow[False] PASSED [ 90%]
  1218. 1743.28 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_workflow_with_custom_instruction_proposer_and_component_selector PASSED [ 90%]
  1219. 1745.02 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_metric_requires_feedback_signature PASSED [ 91%]
  1220. 1746.75 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_reflection_prompt_template_in_gepa_kwargs_raises PASSED [ 91%]
  1221. 1748.39 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_gepa_compile_with_track_usage_no_tuple_error PASSED [ 91%]
  1222. 1750.01 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_component_selector_functionality PASSED [ 91%]
  1223. 1751.72 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_component_selector_default_behavior PASSED [ 91%]
  1224. 1753.43 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_component_selector_string_round_robin PASSED [ 91%]
  1225. 1755.20 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_component_selector_string_all PASSED [ 91%]
  1226. 1756.89 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_component_selector_custom_random PASSED [ 91%]
  1227. 1758.59 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_alternating_half_component_selector PASSED [ 91%]
  1228. 1760.32 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_track_stats_result_structure PASSED [ 91%]
  1229. 1762.08 s [dspy-pytest] tests/teleprompt/test_gepa.py::test_track_best_outputs_result_structure PASSED [ 91%]
  1230. 1763.76 s [dspy-pytest] tests/teleprompt/test_gepa_instruction_proposer.py::test_reflection_lm_gets_structured_images PASSED [ 91%]
  1231. 1765.45 s [dspy-pytest] tests/teleprompt/test_gepa_instruction_proposer.py::test_custom_proposer_without_reflection_lm PASSED [ 91%]
  1232. 1767.28 s [dspy-pytest] tests/teleprompt/test_gepa_instruction_proposer.py::test_image_serialization_into_strings PASSED [ 92%]
  1233. 1769.09 s [dspy-pytest] tests/teleprompt/test_gepa_instruction_proposer.py::test_default_proposer[True] PASSED [ 92%]
  1234. 1770.84 s [dspy-pytest] tests/teleprompt/test_gepa_instruction_proposer.py::test_default_proposer[False] PASSED [ 92%]
  1235. 1772.47 s [dspy-pytest] tests/teleprompt/test_grpo.py::test_grpo_dataset_shuffler PASSED [ 92%]
  1236. 1773.74 s [dspy-pytest] tests/teleprompt/test_grpo.py::test_grpo_dataset_shuffler_with_num_ex_per_step_less_dataset PASSED [ 92%]
  1237. 1774.94 s [dspy-pytest] tests/teleprompt/test_grpo.py::test_grpo_dataset_shuffler_with_num_ex_per_step_greater_dataset PASSED [ 92%]
  1238. 1776.21 s [dspy-pytest] tests/teleprompt/test_knn_fewshot.py::test_knn_few_shot_initialization PASSED [ 92%]
  1239. 1777.93 s [dspy-pytest] tests/teleprompt/test_random_search.py::test_basic_workflow PASSED [ 92%]
  1240. 1779.50 s [dspy-pytest] tests/teleprompt/test_teleprompt.py::test_get_params PASSED [ 92%]
  1241. 1781.41 s [dspy-pytest] tests/teleprompt/test_utils.py::test_eval_candidate_program_full_trainset PASSED [ 92%]
  1242. 1783.28 s [dspy-pytest] tests/teleprompt/test_utils.py::test_eval_candidate_program_minibatch PASSED [ 92%]
  1243. 1785.04 s [dspy-pytest] tests/teleprompt/test_utils.py::test_eval_candidate_program_failure PASSED [ 92%]
  1244. 1786.85 s [dspy-pytest] tests/teleprompt/test_utils.py::test_create_n_fewshot_demo_sets_passes_metric_threshold_for_unshuffled PASSED [ 92%]
  1245. 1788.54 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_on_function PASSED [ 92%]
  1246. 1790.32 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_on_function_with_version PASSED [ 93%]
  1247. 1792.07 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_on_class PASSED [ 93%]
  1248. 1793.83 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_on_class_with_version PASSED [ 93%]
  1249. 1795.45 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_without_docstring PASSED [ 93%]
  1250. 1797.16 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_without_docstring_with_version PASSED [ 93%]
  1251. 1799.00 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_with_callable_syntax PASSED [ 93%]
  1252. 1800.68 s [dspy-pytest] tests/utils/test_annotation.py::test_experimental_decorator_with_version_callable_syntax PASSED [ 93%]
  1253. 1802.40 s [dspy-pytest] tests/utils/test_asyncify.py::test_async_limiter PASSED [ 93%]
  1254. 1808.60 s [dspy-pytest] tests/utils/test_asyncify.py::test_asyncify PASSED [ 93%]
  1255. 1810.30 s [dspy-pytest] tests/utils/test_exceptions.py::test_lm_errors_are_exported_from_dspy PASSED [ 93%]
  1256. 1812.10 s [dspy-pytest] tests/utils/test_exceptions.py::test_retryable_lm_errors_classification PASSED [ 93%]
  1257. 1813.77 s [dspy-pytest] tests/utils/test_exceptions.py::test_lm_error_metadata PASSED [ 93%]
  1258. 1815.50 s [dspy-pytest] tests/utils/test_exceptions.py::test_context_window_exceeded_error_defaults PASSED [ 93%]
  1259. 1817.06 s [dspy-pytest] tests/utils/test_exceptions.py::test_context_window_exceeded_error_with_model PASSED [ 94%]
  1260. 1818.85 s [dspy-pytest] tests/utils/test_exceptions.py::test_context_window_exceeded_error_with_message PASSED [ 94%]
  1261. 1820.56 s [dspy-pytest] tests/utils/test_exceptions.py::test_context_window_exceeded_error_message_without_model PASSED [ 94%]
  1262. 1822.27 s [dspy-pytest] tests/utils/test_exceptions.py::test_adapter_parse_error_basic PASSED [ 94%]
  1263. 1824.00 s [dspy-pytest] tests/utils/test_exceptions.py::test_adapter_parse_error_with_message PASSED [ 94%]
  1264. 1825.72 s [dspy-pytest] tests/utils/test_exceptions.py::test_adapter_parse_error_with_parsed_result PASSED [ 94%]
  1265. 1827.38 s [dspy-pytest] tests/utils/test_lazy_import.py::test_is_available_true_for_stdlib PASSED [ 94%]
  1266. 1829.10 s [dspy-pytest] tests/utils/test_lazy_import.py::test_is_available_false_for_missing PASSED [ 94%]
  1267. 1830.94 s [dspy-pytest] tests/utils/test_lazy_import.py::test_is_available_does_not_import_module PASSED [ 94%]
  1268. 1832.71 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_returns_lazy_module_when_present PASSED [ 94%]
  1269. 1834.40 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_returns_cached_module PASSED [ 94%]
  1270. 1836.38 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_is_safe_under_concurrent_first_use PASSED [ 94%]
  1271. 1838.10 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_assignment_updates_materialized_module PASSED [ 94%]
  1272. 1839.78 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_returns_stub_when_missing PASSED [ 95%]
  1273. 1841.55 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_stub_raises_on_access_with_install_hint PASSED [ 95%]
  1274. 1843.34 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_stub_uses_install_hint_for_litellm PASSED [ 95%]
  1275. 1845.10 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_stub_uses_explicit_extra PASSED [ 95%]
  1276. 1846.84 s [dspy-pytest] tests/utils/test_lazy_import.py::test_require_stub_falls_back_to_module_name PASSED [ 95%]
  1277. 1848.65 s [dspy-pytest] tests/utils/test_lazy_import.py::test_install_hints_match_pyproject_extras PASSED [ 95%]
  1278. 1850.35 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[l-value0] PASSED [ 95%]
  1279. 1852.06 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[t.t.t.t.z-z] PASSED [ 95%]
  1280. 1853.80 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[0]-0] PASSED [ 95%]
  1281. 1855.57 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[1][0]-1] PASSED [ 95%]
  1282. 1857.31 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[1][2]-value4] PASSED [ 95%]
  1283. 1859.05 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["x"]-value5] PASSED [ 95%]
  1284. 1860.87 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["x"]["y"]-y] PASSED [ 95%]
  1285. 1862.57 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["z"]-value7] PASSED [ 96%]
  1286. 1864.22 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["z"][1]-2] PASSED [ 96%]
  1287. 1865.97 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["w"].z-z] PASSED [ 96%]
  1288. 1867.73 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[b["w"].t.l-value10] PASSED [ 96%]
  1289. 1869.48 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].z-z] PASSED [ 96%]
  1290. 1871.25 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[l[-1]-2] PASSED [ 96%]
  1291. 1872.90 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[2].t.a[-1].z-z] PASSED [ 96%]
  1292. 1874.56 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[2].t.b["z"][0]-1] PASSED [ 96%]
  1293. 1876.28 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].t.z-z] PASSED [ 96%]
  1294. 1878.26 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example PASSED [ 96%]
  1295. 1880.40 s [dspy-pytest] tests/utils/test_magicattr.py::test_empty PASSED [ 96%]
  1296. 1880.41 s [dspy-pytest] tests/utils/test_mcp.py::test_convert_mcp_tool SKIPPED (need --extra
  1297. 1880.41 s [dspy-pytest] option to run) [ 96%]
  1298. 1882.27 s [dspy-pytest] tests/utils/test_parallelizer.py::test_worker_threads_independence PASSED [ 96%]
  1299. 1884.06 s [dspy-pytest] tests/utils/test_parallelizer.py::test_parallel_execution_speed PASSED [ 97%]
  1300. 1885.74 s [dspy-pytest] tests/utils/test_parallelizer.py::test_max_errors_handling PASSED [ 97%]
  1301. 1887.51 s [dspy-pytest] tests/utils/test_parallelizer.py::test_max_errors_not_met PASSED [ 97%]
  1302. 1889.23 s [dspy-pytest] tests/utils/test_parallelizer.py::test_parallel_executor_tracks_failed_indices_and_exceptions PASSED [ 97%]
  1303. 1890.89 s [dspy-pytest] tests/utils/test_parallelizer.py::test_sequential_execution_runs_on_main_thread PASSED [ 97%]
  1304. 1892.70 s [dspy-pytest] tests/utils/test_parallelizer.py::test_sequential_max_errors_not_met PASSED [ 97%]
  1305. 1894.49 s [dspy-pytest] tests/utils/test_parallelizer.py::test_sequential_max_errors_exceeded PASSED [ 97%]
  1306. 1896.17 s [dspy-pytest] tests/utils/test_parallelizer.py::test_sequential_tracks_failed_indices_and_exceptions PASSED [ 97%]
  1307. 1897.90 s [dspy-pytest] tests/utils/test_parallelizer.py::test_sequential_compare_results PASSED [ 97%]
  1308. 1899.28 s [dspy-pytest] tests/utils/test_saving.py::test_save_predict PASSED [ 97%]
  1309. 1900.89 s [dspy-pytest] tests/utils/test_saving.py::test_save_custom_model PASSED [ 97%]
  1310. 1902.66 s [dspy-pytest] tests/utils/test_saving.py::test_save_model_with_custom_signature PASSED [ 97%]
  1311. 1902.66 s [dspy-pytest] tests/utils/test_saving.py::test_save_compiled_model SKIPPED (need
  1312. 1902.66 s [dspy-pytest] --extra option to run) [ 97%]
  1313. 1904.10 s [dspy-pytest] tests/utils/test_saving.py::test_load_with_version_mismatch PASSED [ 98%]
  1314. 1905.45 s [dspy-pytest] tests/utils/test_saving.py::test_pickle_loading_requires_explicit_permission PASSED [ 98%]
  1315. 1907.35 s [dspy-pytest] tests/utils/test_saving.py::test_pkl_file_loading_requires_explicit_permission PASSED [ 98%]
  1316. 1909.02 s [dspy-pytest] tests/utils/test_saving.py::test_json_file_loading_works_without_permission PASSED [ 98%]
  1317. 1910.71 s [dspy-pytest] tests/utils/test_settings.py::test_basic_dspy_settings PASSED [ 98%]
  1318. 1912.43 s [dspy-pytest] tests/utils/test_settings.py::test_forbid_configure_call_in_child_thread PASSED [ 98%]
  1319. 1914.19 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_context PASSED [ 98%]
  1320. 1915.92 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_context_parallel PASSED [ 98%]
  1321. 1918.68 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_context_with_dspy_parallel PASSED [ 98%]
  1322. 1921.37 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_context_with_async_task_group PASSED [ 98%]
  1323. 1923.33 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_configure_allowance_async PASSED [ 98%]
  1324. 1925.06 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_settings_save_load PASSED [ 98%]
  1325. 1926.82 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_settings_save_exclude_keys PASSED [ 98%]
  1326. 1928.61 s [dspy-pytest] tests/utils/test_settings.py::test_settings_save_with_extra_modules PASSED [ 99%]
  1327. 1930.26 s [dspy-pytest] tests/utils/test_syncify.py::test_syncify_in_place PASSED [ 99%]
  1328. 1931.76 s [dspy-pytest] tests/utils/test_syncify.py::test_syncify_with_wrapper PASSED [ 99%]
  1329. 1933.76 s [dspy-pytest] tests/utils/test_syncify.py::test_syncify_works_with_optimizers PASSED [ 99%]
  1330. 1940.42 s [dspy-pytest] tests/utils/test_unbatchify.py::test_unbatchify_batch_size_trigger PASSED [ 99%]
  1331. 1942.63 s [dspy-pytest] tests/utils/test_unbatchify.py::test_unbatchify_timeout_trigger PASSED [ 99%]
  1332. 1944.75 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_add_usage_entry PASSED [ 99%]
  1333. 1946.77 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_get_total_tokens PASSED [ 99%]
  1334. 1948.79 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_track_usage_with_multiple_models PASSED [ 99%]
  1335. 1950.99 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_track_usage_context_manager SKIPPED [ 99%]
  1336. 1953.13 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_merge_usage_entries_with_new_keys PASSED [ 99%]
  1337. 1955.29 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_merge_usage_entries_with_none_values PASSED [ 99%]
  1338. 1957.50 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_merge_usage_entries_with_pydantic_models PASSED [ 99%]
  1339. 1959.71 s [dspy-pytest] tests/utils/test_usage_tracker.py::test_parallel_executor_with_usage_tracker PASSED [100%]
  1340. 1959.73 s [dspy-pytest]
  1341. 1959.73 s [dspy-pytest] =============================== warnings summary ===============================
  1342. 1959.73 s [dspy-pytest] tests/clients/test_lm.py::test_chat_lms_can_be_queried
  1343. 1959.73 s [dspy-pytest] tests/clients/test_lm.py::test_lm_calls_support_callables
  1344. 1959.73 s [dspy-pytest] tests/clients/test_lm.py::test_lm_calls_support_pydantic_models
  1345. 1959.73 s [dspy-pytest] /nix/store/rn0r480kscbk8159qi3qjflil71kqglq-dspy-test-env/lib/python3.13/site-packages/pydantic/main.py:464: UserWarning: Pydantic serializer warnings:
  1346. 1959.73 s [dspy-pytest] PydanticSerializationUnexpectedValue(Expected 9 fields but got 5: Expected `Message` - serialized value may not be as expected [field_name='choices', input_value=Message(content='Hi!', ro...ields={'refusal': None}), input_type=Message])
  1347. 1959.73 s [dspy-pytest] PydanticSerializationUnexpectedValue(Expected `StreamingChoices` - serialized value may not be as expected [field_name='choices', input_value=Choices(finish_reason='st...elds={'refusal': None})), input_type=Choices])
  1348. 1959.73 s [dspy-pytest] return self.__pydantic_serializer__.to_python(
  1349. 1959.73 s [dspy-pytest]
  1350. 1959.73 s [dspy-pytest] tests/predict/test_multi_chain_comparison.py::test_basic_example
  1351. 1959.73 s [dspy-pytest] tests/predict/test_multi_chain_comparison.py::test_basic_example
  1352. 1959.73 s [dspy-pytest] tests/predict/test_multi_chain_comparison.py::test_basic_example
  1353. 1959.73 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/dspy/predict/multi_chain_comparison.py:19: DeprecationWarning: The 'prefix' argument in InputField/OutputField is deprecated and has no effect in DSPy. It will be removed in a future version.
  1354. 1959.73 s [dspy-pytest] InputField(
  1355. 1959.73 s [dspy-pytest]
  1356. 1959.73 s [dspy-pytest] tests/predict/test_multi_chain_comparison.py::test_basic_example
  1357. 1959.73 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/dspy/predict/multi_chain_comparison.py:27: DeprecationWarning: The 'prefix' argument in InputField/OutputField is deprecated and has no effect in DSPy. It will be removed in a future version.
  1358. 1959.73 s [dspy-pytest] OutputField(
  1359. 1959.73 s [dspy-pytest]
  1360. 1959.73 s [dspy-pytest] tests/predict/test_predict.py::test_signature_fields_after_dump_and_load_state
  1361. 1959.73 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/tests/predict/test_predict.py:299: DeprecationWarning: The 'prefix' argument in InputField/OutputField is deprecated and has no effect in DSPy. It will be removed in a future version.
  1362. 1959.73 s [dspy-pytest] sentiment = dspy.OutputField(desc="I am a malicious output!", prefix="I am a prefix!")
  1363. 1959.73 s [dspy-pytest]
  1364. 1959.73 s [dspy-pytest] tests/signatures/test_signature.py::test_all_fields_have_prefix
  1365. 1959.73 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/tests/signatures/test_signature.py:46: DeprecationWarning: The 'prefix' argument in InputField/OutputField is deprecated and has no effect in DSPy. It will be removed in a future version.
  1366. 1959.73 s [dspy-pytest] input = InputField(prefix="Modified:")
  1367. 1959.73 s [dspy-pytest]
  1368. 1959.74 s [dspy-pytest] tests/signatures/test_signature.py::test_equality_format
  1369. 1959.74 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/tests/signatures/test_signature.py:157: DeprecationWarning: The 'format' argument in InputField/OutputField is deprecated and has no effect in DSPy. It will be removed in a future version.
  1370. 1959.74 s [dspy-pytest] input = InputField(format=lambda x: x)
  1371. 1959.74 s [dspy-pytest]
  1372. 1959.74 s [dspy-pytest] tests/streaming/test_streaming.py::test_streamify_yields_expected_response_chunks
  1373. 1959.74 s [dspy-pytest] tests/streaming/test_streaming.py::test_streaming_response_yields_expected_response_chunks
  1374. 1959.74 s [dspy-pytest] /nix/store/rn0r480kscbk8159qi3qjflil71kqglq-dspy-test-env/lib/python3.13/site-packages/pydantic/main.py:464: UserWarning: Pydantic serializer warnings:
  1375. 1959.74 s [dspy-pytest] PydanticSerializationUnexpectedValue(Expected 9 fields but got 5: Expected `Message` - serialized value may not be as expected [field_name='choices', input_value=Message(content='{"output...er_specific_fields=None), input_type=Message])
  1376. 1959.74 s [dspy-pytest] PydanticSerializationUnexpectedValue(Expected `StreamingChoices` - serialized value may not be as expected [field_name='choices', input_value=Choices(finish_reason='st...r_specific_fields=None)), input_type=Choices])
  1377. 1959.74 s [dspy-pytest] return self.__pydantic_serializer__.to_python(
  1378. 1959.74 s [dspy-pytest]
  1379. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].z-z]
  1380. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].z-z]
  1381. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[l[-1]-2]
  1382. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[2].t.a[-1].z-z]
  1383. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].t.z-z]
  1384. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1385. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1386. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1387. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1388. 1959.74 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/dspy/utils/magicattr.py:99: DeprecationWarning: ast.Num is deprecated and will be removed in Python 3.14; use ast.Constant instead
  1389. 1959.74 s [dspy-pytest] if hasattr(ast, "Num") and isinstance(node, ast.Num):
  1390. 1959.74 s [dspy-pytest]
  1391. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].z-z]
  1392. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].z-z]
  1393. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[l[-1]-2]
  1394. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[2].t.a[-1].z-z]
  1395. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_magicattr_get[a[-1].t.z-z]
  1396. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1397. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1398. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1399. 1959.74 s [dspy-pytest] tests/utils/test_magicattr.py::test_person_example
  1400. 1959.74 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/dspy/utils/magicattr.py:102: DeprecationWarning: ast.Str is deprecated and will be removed in Python 3.14; use ast.Constant instead
  1401. 1959.74 s [dspy-pytest] elif hasattr(ast, "Str") and isinstance(node, ast.Str):
  1402. 1959.74 s [dspy-pytest]
  1403. 1959.74 s [dspy-pytest] tests/utils/test_settings.py::test_dspy_configure_allowance_async
  1404. 1959.74 s [dspy-pytest] /build/r9a1svd8gqmcs0gcy8lz2ssr6798r95l-source/tests/utils/test_settings.py:194: RuntimeWarning: coroutine 'test_dspy_configure_allowance_async.<locals>.foo4' was never awaited
  1405. 1959.74 s [dspy-pytest] foo4()
  1406. 1959.74 s [dspy-pytest] Enable tracemalloc to get traceback where the object was allocated.
  1407. 1959.74 s [dspy-pytest] See https://docs.pytest.org/en/stable/how-to/capture-warnings.html#resource-warnings for more info.
  1408. 1959.74 s [dspy-pytest]
  1409. 1959.74 s [dspy-pytest] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
  1410. 1959.74 s [dspy-pytest] === 984 passed, 330 skipped, 9 deselected, 31 warnings in 1956.54s (0:32:36) ===
  1411. 1961.22 s [dspy-pytest] checkPhase completed in 32 minutes 40 seconds
  1412. 1961.22 s [dspy-pytest] Phase: installPhase
  1413. 1961.22 s [dspy-pytest] Phase: fixupPhase
  1414. 1961.23 s [dspy-pytest] shrinking RPATHs of ELF executables and libraries in /nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest
  1415. 1961.23 s [dspy-pytest] checking for references to /build/ in /nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest...
  1416. 1961.24 s [dspy-pytest] patching script interpreter paths in /nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest
  1417. 1962.25 s [dspy-pytest:post-build] Uploading to the NixCI staging cache: /nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest
  1418. 1962.29 s [dspy-pytest:post-build] warning: 'warn-short-path-literals' is deprecated, use 'lint-short-path-literals = ignore' instead
  1419. 1962.29 s [dspy-pytest:post-build] copying 1 paths...
  1420. 1962.29 s [dspy-pytest:post-build] copying path '/nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest' to 'https://cache.staging.nix-ci.com'...
  1421. 1962.85 s [dspy-pytest:post-build] warning: 'warn-short-path-literals' is deprecated, use 'lint-short-path-literals = ignore' instead
  1422. 1963.71 s [dspy-pytest:post-build] copying 1 paths...
  1423. 1963.71 s [dspy-pytest:post-build] copying path '/nix/store/rcq49d990xqb45ygc83sng306xk2cspr-dspy-pytest.drv' to 'https://cache.staging.nix-ci.com'...
  1424. 1964.29 s Progress: 1 of 2 built
  1425. 1964.29 s Progress: 2 of 2 built
  1426. 1964.29 s /nix/store/fk3rqwc1r9f58lrw42cwx7qbgxbs3c8k-dspy-pytest
  1427. 1964.31 s Build succeeded.
More Logs Raw Logs

Agent Instructions

Wait for completion, without logs:

curl --netrc -N https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/wait

Latest logs, with timestamps (streams while running):

curl --netrc -N https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/tail

All logs, with timestamps (available after completion):

curl --netrc https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/logs

Raw logs, from the start (no timestamps):

curl --netrc -N https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/raw-logs

Content types available for /logs and /tail (use Accept header):

Example:

curl --netrc -H "Accept: text/csv" https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/logs

Reproduce locally: https://staging.nix-ci.com/gh:NorfairKing:dspy/your-first-flake/453ecf257a343742170b3e1cef20271508c3e6a4/7bc152d7-33b7-4175-b7a7-1a0233a07a35/repro

This page is also available in machine-friendly formats. Request one with the Accept header:

For more instructions, fetch https://staging.nix-ci.com/instructions .