Jun 28, 2022
Yes, if we leave it to spark to inferschema then it will trigger an additional job to infer the schema ( assuming an action is called) . However, if we mention our own schema, it doesn't create and trigger an additional job.
Yes, if we leave it to spark to inferschema then it will trigger an additional job to infer the schema ( assuming an action is called) . However, if we mention our own schema, it doesn't create and trigger an additional job.