How does Logic-Logit use logic rules to model human choices interpretably?

Logic-Logit learns OR-of-ANDs rules to model choices, pairing interpretable rule sets with competitive accuracy.

Direct answer

Logic-Logit models each person's choice as a weighted sum of OR-of-ANDs logic rules: a rule fires when all its conditions hold, and an option's utility is the weighted total of the rules it satisfies. The paper reports that this rule-based model beat baseline models on both interpretability and accuracy across synthetic data and real commercial and healthcare datasets, though the evidence packet gives no per-dataset numbers.

1sources cited

This article was generated with WisPaper-powered search and paper analysis.

Choices as screened sets of satisfied rules

The paper starts from a consider-then-choose account of decision making: people first filter a large option set with heuristic rules, then choose from what remains. Those rules are written as disjunctions of conjunctions, or OR-of-ANDs. A single conjunction such as "affordable AND near a good school" fires only when every condition holds; several such conjunctions joined by OR form one decision rule.

Logic-Logit turns this into a utility model. Each conjunction acts as a Boolean feature that is 1 when its conditions hold and 0 otherwise, and an option's utility is a weighted sum of the conjunctions it satisfies. Choice probabilities then come from a multinomial logit over those utilities. The weights are what the model learns, so a fitted model can be read as a short list of rules with associated weights rather than as an opaque parameter vector.

Predicates convert raw features into checkable conditions

Before any rule can be built, the model needs a fixed set of predicates: Boolean tests that map a feature vector to 0 or 1. The paper keeps this mapping predefined and fixed, so rule learning operates over conditions the analyst has already defined rather than inventing new ones.

For discrete features the paper uses equality-style conditions, such as whether a house has three rooms; a feature with ten possible values naturally yields ten predicates. For continuous features it thresholds values at percentiles of the dataset, for example whether a house price ranks in the top 20% or whether its area fails to rank in the top 60%. The number of percentile thresholds is a hyperparameter: denser thresholds sharpen rule content but enlarge the search space and make rule search harder. Because thresholds follow the feature distribution, the approach also reduces the influence of outliers and feature scales that trouble linear models.

A mixture lets different preference types use different rules

A single rule set would force every decision maker into one rationale, so the paper extends Logic-Logit to a Mixed Logic-Logit model. The rule-weight vector is treated as a draw from a latent mixture distribution, and the choice probability is the expectation of the logit probability over that distribution. Each component of the mixture is a preference type with its own rules and weights.

The paper's illustrative scenario makes the intent concrete: middle-class families with children use rules combining affordability with proximity to a good school or work, single professionals combine modern amenities with proximity to entertainment or work, and wealthy buyers combine luxury features, an exclusive neighborhood, or a large lot. These are illustrative preference structures in the paper, not estimated results from a named dataset.

Column generation keeps an exponential rule space searchable

Learning the mixture is posed as minimizing negative log-likelihood over a distribution of rule weights, solved with a functional conditional gradient, or Frank-Wolfe, algorithm. Each Frank-Wolfe step must find a new preference type, which means searching over conjunctions. With M predicates there are 2^M − 1 possible conjunctions, so the paper describes the rule-extraction problem as NP-hard and the search space as combinatorial.

The paper's answer is column generation. A master problem re-optimizes weights for the rules currently in the set, which is a smaller optimization over the existing rules. A subproblem then searches for one new rule that improves the objective, using the gradient of the loss with respect to a candidate rule's weight: the absolute gradient indicates a rule's potential, and the top candidates are added to the set. Search proceeds breadth-first by conjunction length up to a maximum length K, with depth-first extension from already-found shorter rules when moving to the next length. Rules whose weights fall below a threshold can be pruned after the master problem.

Offer-set features matter only when combined with option features

The model separates option-specific features from offer-set features and treats them differently. A rule made only of offer-set features is skipped during search, because offer-set features are common to every option in the same offer set and therefore cancel out in the softmax regardless of the rule's weight.

Such rules become functional only when conjoined with option-specific features. In the paper's reading, option-feature rules describe how attractive an individual option is, while offer-set rules describe the situations in which those option rules apply. This is a structural constraint on what a learned rule can mean, not an empirical finding about any particular dataset.

Interpretability is bought with a different parameter structure

The paper compares model families on utility form, parameter count, and grounds for interpretability. Logic-Logit uses a rule-based utility with O(Nn) parameters, where N is the number of consumer types and n the maximum number of rules, and its interpretability rests on rule content and rule weights. MNL is linear with O(d) feature weights, and Mix-MNL uses O(Nd). Neural baselines such as Vanilla NN, TasteNet, DeepMNL, MixDeepMNL, and RUMNet are grouped as NN-based, with parameter counts depending on latent dimensions and layer count; the paper treats their interpretability as negligible because of their inherent complexity.

The comparison matters because it frames the trade-off the paper is claiming: the rule-based model is meant to keep a readable rationale while still representing heterogeneous preference types, whereas the flexible neural alternatives carry large parameter sets without a comparable rule-level explanation.

Reported gains span synthetic and real-world evaluations

The empirical evaluation covers synthetic datasets with clearly defined predicates, ground-truth consumer types, and decision rules, plus two real-world datasets from commercial and healthcare domains. The abstract states that Logic-Logit significantly outperforms baseline models in terms of interpretability and accuracy.

The evidence packet does not provide per-dataset accuracy figures, effect sizes, or the specific baselines used in each comparison, so the size of the advantage cannot be checked here. What can be stated is the paper's own claim of significant improvement on both dimensions across those evaluation settings, and the design choice to test first on synthetic data with known rules before moving to real data.

The rule reading depends on analyst-defined predicates

The interpretability claim is bounded by the predicate design. Predicates are predefined and fixed, and for continuous features they come from percentile thresholds chosen as a hyperparameter. A reader interpreting a learned rule is therefore interpreting conditions the analyst supplied, and denser thresholds trade sharper rule content against a harder search.

The mixture also means interpretability is per preference type: the model explains choices through several rule sets with proportions, not through one universal rule. Within those bounds, the paper's distinctive priority is the combination itself, using column generation inside a Frank-Wolfe mixture to extract compact OR-of-ANDs rule sets, and the claim that this yields both more transparent and more accurate choice predictions than the baselines it tested.

Sources used in this answer

1

Logic-Logit: A Logic-Based Approach to Choice Modeling

Logic-Logit learns OR-of-ANDs logic rules within a mixture model via column generation and Frank-Wolfe, and the paper reports it outperforms baselines on interpretability and accuracy on synthetic and real commercial and healthcare data.