Make sure that tests that pass don't crash
Follow up from #559

Sometimes when tests crash with sigsegv they get treated as if they passed. We need to investigate why and make sure it doesn't happen to any other tests