Laravel is Slow
If you’re using a Framework it does not mean that you need to do every single task with the “most beautiful available tool”, in this case: Eloquent.
You could just spin up a \DB::class for this, and make this happen with a single INSERT … ON DUPLICATE KEY UPDATE … query.