In the present study, we create an analog of a math task for judging whether one integer is greater than another. Shapes represent integers, colors denote sign, and spatial arrangement depicts the comparison. Across two experiments, we find that this discovery task is surprisingly hard: after approximately 120 trials with feedback, average final performance is about 58%, not far above chance. Additionally, training on sub-rules using a variety of previously effective treatments provide only short-term benefit to relational rule discovery. Our findings highlight the difficulty of learning complex relational structures purely from feedback, underscoring the possible need for more explicit guidance or extended practice to achieve robust transfer.