A Modal Logic for Temporal and Jurisdictional Classifier Models
Di Florio, Dong, Rotolo
Logic-based models can be used to build verification tools for machine learning classifiers employed in the legal field. ML classifiers predict the outcomes of new cases based on previous ones, thereby performing a form of case-based reasoning (CBR). In this paper, we introduce a modal logic of classifiers designed to formally capture legal CBR. We incorporate principles for resolving conflicts between precedents, by introducing into the logic the temporal dimension of cases and the hierarchy of courts within the legal system.
academic
A Modal Logic for Temporal and Jurisdictional Classifier Models
Logic-based models can be used to build verification tools for machine learning classifiers employed in the legal field. ML classifiers predict the outcomes of new cases based on previous ones, thereby performing a form of case-based reasoning (CBR). In this paper, we introduce a modal logic of classifiers designed to formally capture legal CBR. We incorporate principles for resolving conflicts between precedents, by introducing into the logic the temporal dimension of cases and the hierarchy of courts within the legal system.
Verification Requirements for Legal AI: Machine learning classifiers are increasingly applied in the legal field, but their normative correctness, accuracy, and robustness cannot be guaranteed, raising concerns among judges.
Precedential Constraint Problem: In common law systems, classifiers must satisfy precedential constraints and follow the principle of stare decisis (following precedent).
Precedent Conflicts: Real legal systems contain conflicting precedents, while existing Horty models assume case base consistency and cannot handle conflicting precedents.
Legal case-based reasoning is inherently a form of case-based reasoning (CBR), where machine learning classifiers predict outcomes of new cases based on historical cases. However, existing models cannot handle precedent conflicts and require the introduction of temporal and hierarchical dimensions to address this issue.
Extension of BCL Framework: Building upon the Binary Classifier Logic (BCL), introduces temporal and hierarchical operators to construct the Temporal and Jurisdictional Classifier Model (TJCM).
Formalization of Precedent Concepts: Strictly defines the concepts of precedents, potentially binding precedents, and binding precedents.
Exception Handling Mechanism: Models two types of precedent exceptions—overruling and per incuriam (wrongly decided).
Conflict Resolution Principles: Formalizes precedent conflict resolution principles based on temporal-hierarchical relationships.
Completeness Proof: Provides axiomatization and completeness proof for the TJCL logical system.
Input: New legal case, including factual factors, court of jurisdiction, case name
Output: Predicted judgment outcome (plaintiff prevails = 1, defendant prevails = 0, undecided = ?)
Constraints: Must comply with precedential constraints and temporal-hierarchical principles
Definition 2: TJCM = (S, f, Jur, ≤T, R)
- S ⊆ 2^Atm0: Set of states (each state contains a unique court)
- f: S → Val: Decision function, Val = {1, 0, ?}
- ≤T: Total preorder on S (temporal relation)
- R ⊆ S × S: Relevance relation
The paper cites 25 related references, primarily including:
Horty (2011): Rules and reasons in precedent theory
Liu et al. (2022, 2023): Logical frameworks for classifier systems
Ashley (1990): Legal argumentation modeling
Blackburn et al. (2001): Theoretical foundations of modal logic
MacCormick & Summers (1997): Comparative study of precedent interpretation
Overall Assessment: This is an excellent theoretical paper making important contributions at the intersection of legal AI and logic. While it has some limitations in empirical verification, the rigor and novelty of its theoretical framework give it significant academic value and practical potential.