Skip to content

from_csv: wrong results in permissive modes and failure with a variant schema #6800

Open
Open
from_csv: wrong results in permissive modes and failure with a variant schema#6800
Labels
expressionSpark expression relatedrequires-triagespark sql testsSpark SQL test failures

Description

@andygrove
andygrove
opened on Oct 8, 2026

Found while enabling spark.comet.exec.localTableScan.enabled by default in draft PR #6780 (Spark 4.1 SQL tests and [scans] job). Part of #4347.

CsvFunctionsSuite "from_csv invalid csv - check modes" (results differ), "from_csv with variant" (ArrayIndexOutOfBoundsException in GenericInternalRow). Not yet diagnosed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    expressionSpark expression relatedrequires-triagespark sql testsSpark SQL test failures

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions