The simulator may send different message sets to nodes
The test failure I mentioned before is a test that is explicitly designed to send different sets of signatures to different nodes, to see how the executor responds. That test depends on the assumption that the simulator's dispatch of transactions is extremely predictable, however this appears to no longer be the case, so that test fails. !844 (merged) resolves the majority of failures caused by this issue, but TestDifferentValidatorSignaturesV1 is broken by this issue.
This job shows a test failing due to a simulator consensus error. The recording for that test indicates that the simulator sent different sets of messages to the nodes in the block that failed. The log and artifacts are attached, in case the job gets pruned.
Edited by Ethan Reesor