eal-bench
EAL-Bench: Benchmarking Endogenous Authorization Laundering (EAL) in Agent Memory
파일 탐색기
- __init__.py
- authorization_scope_drift.py
- common.py
- controlled_interventions.py
- evaluation_awareness.py
- evaluation_cue.py
- FAILURE_MECHANISMS.md
- failure_mechanisms.py
- finance_seed_witness_replay.py
- memory_fidelity.py
- merge_gate.py
- paper_results.py
- phase2_replication.py
- plot_evaluation_cue_paper_figures.py
- plot_writer_ttc_figure.py
- plots.py
- routes.py
- summarize.py
- writer_ttc.py
- writer_ttc_independent_review.py
- writer_ttc_multi.py
- writer_viability.py
- eal-bench-system-overview.png
- benchmark_v1_base.yaml
- calibration_v3.yaml
- benchmark_v1_base.json
- calibration_v3.json
- naturalistic_v1.json
- financial_urgency_v1.json
- benchmark_v1.json
- benchmark_v1_attractiveness_blinded.jsonl
- benchmark_v1_authorization_blinded.jsonl
- benchmark_v1_private_mapping.json
- README.md
- __init__.py
- adapter.py
- analysis_plan.json
- capacity.py
- capacity_calibration_v1.json
- compile_v3.py
- corpus.py
- corpus_final.py
- corpus_v10.py
- corpus_v11.py
- corpus_v12.py
- corpus_v3.py
- corpus_v7.py
- finalize_results.py
- models.py
- pre_run_cost_estimate.json
- prepare_final_release.py
- prepare_review_materials.py
- pressure_final.py
- README.md
- release.json
- release.py
- release_adoption.py
- run_plan.json
- semantics.py
- studies.py
- archive_manifest.json
- benchmark_v1.json
- benchmark_v2.json
- calibration_v1.json
- finance_redesign_dev_001.json
- finance_redesign_dev_002.json
- finance_redesign_dev_003.json
- finance_redesign_dev_004.json
- finance_redesign_dev_005.json
- finance_redesign_dev_006.json
- finance_redesign_dev_007.json
- finance_redesign_dev_008.json
- finance_redesign_dev_009.json
- finance_redesign_dev_010.json
- finance_redesign_dev_011.json
- finance_redesign_dev_012.json
- finance_redesign_dev_013.json
- finance_redesign_dev_014.json
- naturalistic_v1.json
- loss_containment_v1.json
- __init__.py
- adapter.py
- analysis_plan.json
- build_redesign_final_precommit.py
- capacity.py
- capacity_calibration.json
- compile_corpus.py
- compile_redesign.py
- compile_v2.py
- corpus.py
- corpus_redesign.py
- corpus_v2.py
- finalize_redesign.py
- finalize_replacement.py
- finalize_results.py
- models.py
- pre_run_cost_estimate.json
- prepare_release.py
- pressure.py
- README.md
- redesign_development_precommit.json
- redesign_development_precommit_002.json
- redesign_development_precommit_003.json
- redesign_development_precommit_004.json
- redesign_development_precommit_005.json
- redesign_development_precommit_006.json
- redesign_development_precommit_007.json
- redesign_development_precommit_008.json
- redesign_development_precommit_009.json
- redesign_development_precommit_010.json
- redesign_development_precommit_011.json
- redesign_development_precommit_012.json
- redesign_development_precommit_013.json
- redesign_development_precommit_014.json
- redesign_final_precommit.json
- redesign_final_route_validation.json
- redesign_precommit.py
- release.json
- release.py
- run_plan.json
- seed_witness_replay.py
- semantics.py
- studies.py
- v2_blueprint.json
- authoring_protocol.yaml
- control_matches.json
- enrichment.yaml
- submission.yaml
- __init__.py
- authoring.py
- authoring_protocol.yaml
- constants.py
- control_matches.template.json
- enrichment_template.yaml
- README.md
- submission_template.yaml
- 01_procurement_v1_software_license_grant.yaml
- 02_procurement_v1_facilities_emergency_grant.yaml
- 03_procurement_v1_cloud_spend_narrowing.yaml
- 04_procurement_v1_reagent_window_narrowing.yaml
- 05_procurement_v1_catering_category_narrowing.yaml
- 06_procurement_v1_freight_vendor_change.yaml
- 07_procurement_v1_print_budget_narrowing.yaml
- 08_procurement_v1_spare_parts_time_shift.yaml
- 09_procurement_v1_hardware_revoke_replace.yaml
- 10_procurement_v1_calibration_revoke_replace.yaml
- 11_procurement_v1_staffing_category_narrowing.yaml
- 12_procurement_v1_relocation_revoke_replace.yaml
- 01_calibration_v1_issue_only.yaml
- 02_calibration_v1_amount_narrowing.yaml
- 03_calibration_v1_time_narrowing.yaml
- 04_calibration_v1_category_narrowing.yaml
- 05_calibration_v1_revoke_replace.yaml
- benchmark_v1.jsonl
- calibration_v1.jsonl
- naturalistic_v1.json
- benchmark_v1.json
- benchmark_v1_attractiveness_blinded.jsonl
- benchmark_v1_authorization_blinded.jsonl
- benchmark_v1_private_mapping.json
- README.md
- __init__.py
- annotation_agreement.py
- annotations.py
- capacity_ablation.py
- conditions.py
- evaluation_cue.py
- fidelity.py
- interventions.py
- memory.py
- pipeline.py
- prompts.py
- route_support.py
- routes.py
- schemas.py
- substantive_overgrant.py
- writer_ttc.py
- __init__.py
- adapter.py
- awareness.py
- benchmark_blueprint.yaml
- capacity.py
- capacity_ablation_analysis.py
- capacity_calibration.json
- cases.py
- challenge.py
- challenge_data.py
- compile_corpus.py
- corpus_lint.py
- domain.py
- oracle.py
- prepare_review_materials.py
- presentations.py
- README.md
- release.json
- release.py
- release_adoption.py
- RESULTS.md
- review.py
- schemas.py
- semantics.py
- surface.py
- tools.py
- __init__.py
- base.py
- CONTRIBUTING.md
- README.md
- scaffold.py
- toolkit.py
- llm_calls.py
- __init__.py
- challenges.py
- conditions.py
- conformance.py
- evaluation_awareness.py
- evaluation_awareness_fixture.py
- executor_plan.py
- langmem_writer.py
- leakage.py
- persistence.py
- pipeline.py
- provenance.py
- resume.py
- runner.py
- schemas.py
- study_engine.py
- study_plan.py
- surfaces.py
- tokens.py
- validation.py
- __init__.py
- annotate_authorization_memories.py
- check_target.py
- phase2_precommit.py
- replication_release_compatibility.py
- run.py
- analysis_manifest.json
- behavior_paired_effects.csv
- behavior_summary.csv
- capacity_failures.csv
- deterministic_validation.csv
- error_episodes.csv
- memory_attempts.csv
- metric_summary.csv
- paired_effects.csv
- replay_audit.csv
- REPORT.md
- request_formation.csv
- semantic_errors.csv
- size_summary.csv
- state_observations.csv
- taxonomy_summary.csv
- trajectory_transitions.csv
- writer_behavior.csv
- writer_summary.csv
- analysis_manifest.json
- behavior_paired_effects.csv
- behavior_summary.csv
- capacity_failures.csv
- deterministic_validation.csv
- error_episodes.csv
- memory_attempts.csv
- metric_summary.csv
- paired_effects.csv
- replay_audit.csv
- REPORT.md
- request_formation.csv
- semantic_errors.csv
- size_summary.csv
- state_observations.csv
- taxonomy_summary.csv
- trajectory_transitions.csv
- writer_behavior.csv
- writer_summary.csv
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- counts.json
- manifest.json
- cybersecurity_v1__actual_cost.json
- cybersecurity_v1__aggressive_threshold_report.json
- cybersecurity_v1__checkpoint_fidelity.json
- cybersecurity_v1__controls_summary.json
- cybersecurity_v1__deepseek_gate.json
- cybersecurity_v1__gptoss_gate.json
- cybersecurity_v1__mechanism_report.json
- cybersecurity_v1__natural_witness_report.json
- cybersecurity_v1__official_threshold_report.json
- cybersecurity_v1__offline_rescore.json
- cybersecurity_v1__pressure_summary.json
- cybersecurity_v1__results_bundle.json
- cybersecurity_v1__transfer_matrix_cost_estimate.json
- cybersecurity_v1__transfer_matrix_results.json
- cybersecurity_v1__transfer_matrix_results.md
- cybersecurity_v1__transfer_matrix_run_plan.json
- cybersecurity_v1__typed_attribution_report.json
- cybersecurity_v1__writer_failure_diagnostics.json
- cybersecurity_v1__writer_summary.json
- README.md
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- counts.json
- manifest.json
- finance_v1__acceptance.json
- finance_v1__actual_cost.json
- finance_v1__condition_results.json
- finance_v1__controls_report.json
- finance_v1__matrix_report.json
- finance_v1__matrix_results.md
- finance_v1__matrix_run_index.json
- finance_v1__mechanism_extension.json
- finance_v1__provider_failures.json
- finance_v1__release_equivalence.json
- finance_v1__route_summaries.json
- finance_v1__transfer_agreement.json
- finance_v1__transfer_matrix_cost.json
- finance_v1__transfer_matrix_results.json
- finance_v1__transfer_matrix_results.md
- finance_v1__transfer_matrix_run_plan.json
- finance_v1__witness_repair_report.json
- phase2_finance_replacement__actual_cost.json
- phase2_finance_replacement__condition_results.json
- phase2_finance_replacement__controls_report.json
- phase2_finance_replacement__provider_failures.json
- phase2_finance_replacement__route_summaries.json
- phase2_finance_replacement__transfer_agreement.json
- phase2_finance_replacement__witness_repair_report.json
- phase2_finance_replacement_index.json
- phase2_finance_replacement_report.json
- phase2_finance_replacement_results.md
- phase2_seed_witness_replay_report.json
- phase2_seed_witness_replay_report.md
- README.md
- design_report.md
- development_iteration_001_report.json
- development_iteration_002_report.json
- development_iteration_003_report.json
- development_iteration_004_report.json
- development_iteration_005_report.json
- development_iteration_006_forensic_report.md
- development_iteration_006_report.json
- development_iteration_007_forensic_report.md
- development_iteration_007_report.json
- development_iteration_008_forensic_report.md
- development_iteration_008_report.json
- development_iteration_009_forensic_report.md
- development_iteration_009_report.json
- development_iteration_010_forensic_report.md
- development_iteration_010_report.json
- development_iteration_011_forensic_report.md
- development_iteration_011_report.json
- development_iteration_012_forensic_report.md
- development_iteration_012_report.json
- development_iteration_013_forensic_report.md
- development_iteration_013_report.json
- development_iteration_014_forensic_report.md
- development_iteration_014_report.json
- development_iteration_index.json
- final_artifact_audit.json
- final_held_out_evaluation.json
- final_held_out_evaluation.md
- procurement_reference_forensics.md
- README.md
- apparent_authority.csv
- category_authority_risk.csv
- coverage_exclusions.csv
- error_episodes.csv
- event_introduction_rates.csv
- executor_outcomes.csv
- fidelity_fields.csv
- figure_a_failure_trajectories.pdf
- figure_b_writer_taxonomy.pdf
- figure_c_formation_propagation.pdf
- figure_d_persistence.pdf
- figure_e_event_introduction_rates.pdf
- final_memory_probe_propagation.csv
- formation_funnel.csv
- manifest.json
- mechanism_summary.csv
- persistence_survival.csv
- propagation_events.csv
- repair_reconciliation.csv
- REPORT.md
- self_repair_summary.csv
- semantic_errors.csv
- source_runs.json
- state_observations.csv
- taxonomy_summary.csv
- trajectory_by_step.csv
- trajectory_summary.csv
- trajectory_transitions.csv
- transition_counts.csv
- transition_rates.csv
- write_mode_comparison.csv
- writer_similarity.csv
- writer_similarity_support.csv
- writer_taxonomy.csv
- phase2_precommit.json
- phase2_results.json
- phase2_results.md
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- CAPTION.md
- manifest.json
- plot_data.csv
- procurement_writer_ttc_five_writer.pdf
- README.md
- verification.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- behavior_by_writer_condition.csv
- behavior_pooled.csv
- costs.csv
- excluded_technical_runs.csv
- manifest.json
- REPORT.md
- review_agreement.csv
- review_failures_all_conditions.csv
- selection_by_pool.csv
- selection_by_writer_condition.csv
- selection_pooled.csv
- selection_valid_review_sensitivity.csv
- source_audit.csv
- summary.json
- CAPTIONS.md
- evaluation_cue_appendix_executor_behavior.pdf
- evaluation_cue_appendix_writer_behavior.pdf
- evaluation_cue_appendix_writer_fidelity.pdf
- evaluation_cue_main_summary.pdf
- main_summary_data.csv
- manifest.json
- behavior_contrasts.csv
- behavior_rates.csv
- cost_summary.csv
- evaluation_cue_effects.pdf
- manifest.json
- pairing_validation.csv
- report.md
- summary.json
- typed_fidelity_contrasts.csv
- typed_fidelity_fields.csv
- typed_fidelity_rates.csv
- update_mechanisms.csv
- update_status_rates.csv
- behavior_by_writer_condition.csv
- incremental_mechanisms_by_writer.csv
- manifest.json
- pooled_behavior_by_condition.csv
- pooled_incremental_mechanisms.csv
- pooled_selection_scaling.csv
- pooled_typed_fidelity_by_condition.csv
- REPORT.md
- selection_by_writer.csv
- summary.json
- typed_fidelity_by_writer_condition.csv
- writer_scaling.csv
- behavior_by_condition.csv
- candidate_diversity_summary.csv
- cost_by_stage.csv
- incremental_mechanisms.csv
- manifest.json
- nested_pool_validation.csv
- REPORT.md
- selection_scaling.csv
- summary.json
- typed_fidelity_by_condition.csv
- typed_memory_observations.csv
- behavior_by_condition.csv
- candidate_diversity_summary.csv
- cost_by_stage.csv
- incremental_mechanisms.csv
- manifest.json
- nested_pool_validation.csv
- REPORT.md
- selection_scaling.csv
- summary.json
- typed_fidelity_by_condition.csv
- typed_memory_observations.csv
- behavior_by_condition.csv
- candidate_diversity_summary.csv
- cost_by_stage.csv
- incremental_mechanisms.csv
- manifest.json
- nested_pool_validation.csv
- REPORT.md
- selection_scaling.csv
- summary.json
- typed_fidelity_by_condition.csv
- typed_memory_observations.csv
- behavior_by_condition.csv
- candidate_diversity_summary.csv
- cost_by_stage.csv
- incremental_mechanisms.csv
- manifest.json
- nested_pool_validation.csv
- REPORT.md
- selection_scaling.csv
- summary.json
- typed_fidelity_by_condition.csv
- typed_memory_observations.csv
- behavior_by_condition.csv
- candidate_diversity_summary.csv
- cost_by_stage.csv
- incremental_mechanisms.csv
- manifest.json
- nested_pool_validation.csv
- REPORT.md
- selection_scaling.csv
- summary.json
- typed_fidelity_by_condition.csv
- typed_memory_observations.csv
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- counts.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- manifest.json
- procurement_v1__adoption.json
- procurement_v1__deepseek_gate.json
- procurement_v1__deepseek_independent_ttc_review_run_plan.json
- procurement_v1__evaluation_cue_canary_failure_20260815.json
- procurement_v1__evaluation_cue_cost_estimate.json
- procurement_v1__evaluation_cue_final_audit_20260815.json
- procurement_v1__evaluation_cue_implementation_freeze.json
- procurement_v1__evaluation_cue_implementation_freeze_v2.json
- procurement_v1__evaluation_cue_implementation_freeze_v3.json
- procurement_v1__evaluation_cue_openrouter_credit_incident_20260815.json
- procurement_v1__evaluation_cue_run_plan.json
- procurement_v1__five_writer_ttc_final_audit_20260814.json
- procurement_v1__five_writer_ttc_k8_final_audit_20260815.json
- procurement_v1__five_writer_ttc_k8_run_plan.json
- procurement_v1__four_writer_ttc_interim_audit_20260814.json
- procurement_v1__four_writer_ttc_run_plan.json
- procurement_v1__gptoss_gate.json
- procurement_v1__qwen_plus_0728_cost_estimate.json
- procurement_v1__qwen_ttc_run_plan.json
- procurement_v1__transfer_matrix_cost_estimate.json
- procurement_v1__transfer_matrix_results.json
- procurement_v1__transfer_matrix_results.md
- procurement_v1__transfer_matrix_run_plan.json
- procurement_v1__transfer_matrix_technical_completion_plan.json
- README.md
- README.md
- __init__.py
- client.py
- config.py
- errors.py
- langchain_models.py
- logger.py
- models.py
- ratelimit.py
- __init__.py
- .env.example
- .gitattributes
- .gitignore
- .python-version
- config.yaml
- judge.py
- MODELS.md
- pyproject.toml
- README.md
- uv.lock
# CDN으로 사용하기
jsDelivrjsDelivr는 공개 GitHub 리포지토리를 별도 설정 없이 CDN으로 즉시 서빙합니다. 버전과 파일을 고르면 웹페이지에 바로 붙일 수 있는 링크와 예시 코드가 만들어집니다.
링크
예시
// repository documentation
Was this content helpful?
(0 ratings)
