Skip to content

Data classification: The generated Console App and Web API projects are running failed. #2418

New issue
New issue
Closed
Closed
Data classification: The generated Console App and Web API projects are running failed.#2418
Assignees
zewditu
Labels
Priority:0Work that we can't release withoutReported by: Test
Milestone
March 2023

Description

@v-Hailishi
v-Hailishi
opened on Dec 15, 2022

System Information (please complete the following information):
Windows OS: Windows-11-Enterprise-22H2
ML.Net Model Builder 2022: 16.14.0.2261401 (Main Build)
Microsoft Visual Studio Enterprise: 2022(17.4.1)
.Net: 6.0

Describe the bug

  • On which step of the process did you run into an issue:
    The generated Console App is running failed.

Data Source
https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv
SQL Password

To Reproduce
Steps to reproduce the behavior:

  1. Select Create a new project from the Visual Studio 2022 start window.
  2. Choose the C# Console App (.NET Core6.0) project template.
  3. Add model builder by right click on the project.
  4. Select Data classification scenario.
  5. On Data page, select the data source and choose Sentiment column as label.
  6. On the Train page, click "Start training" button to complete the training.
  7. Click "Add to solution" button on the Consume page to generate Console App project.
  8. Run the generated Console App project.

Expected behavior
The generated Console App project should be running successfully.

Screenshots
File:
image
SQL Password:
image

Additional context:

Activity

  1. v-Hailishi
    added
    Priority:0Work that we can't release without
    Reported by: Test
    on Dec 15, 2022
  2. v-Hailishi
    changed the title [-]Data classification: The generated Console App project is running failed.[/-] [+]Data classification: The generated Console App and Web API projects are running failed.[/+] on Dec 15, 2022

  3. v-Hailishi commented on Dec 15, 2022

    @v-Hailishi
    v-Hailishi
    on Dec 15, 2022
    Author

    The bug is also repro for Text classification scenario: The generated Console App project is running failed; the generated Web API project is running successfully.
    image

  4. zewditu commented on Dec 16, 2022

    @zewditu
    zewditu
    on Dec 16, 2022
    Contributor

    Regressed by this PR https://github.com/dotnet/machinelearning-tools/pull/1624.

  5. v-Hailishi commented on Dec 19, 2022

    @v-Hailishi
    v-Hailishi
    on Dec 19, 2022
    Author

    The bug is still repro on the latest main build: 16.14.0.2261601
    File:
    image
    image
    SQL Password:
    image
    image

  6. beccamc
    added this to the January 2023 milestone on Dec 19, 2022

  7. beccamc commented on Dec 19, 2022

    @beccamc
    beccamc
    on Dec 19, 2022
    Contributor

    Thanks for finding this @v-Hailishi!

    Dev team - possible root cause is that this is binary classification?

  8. v-Hailishi commented on Dec 22, 2022

    @v-Hailishi
    v-Hailishi
    on Dec 22, 2022
    Author

    Verified on the latest main build 16.14.0.2262002, the bug is repro on Data classification, Value predication, Recommendation, Forecasting, Text classification scenarios.

  9. zewditu commented on Jan 3, 2023

    @zewditu
    zewditu
    on Jan 3, 2023
    Contributor

    For this
    image
    binary is not an issue , it happens for text classification types such as data-classification(binary and multi) and Text- classification but it is not consistence

  10. zewditu
    self-assigned this
    on Jan 3, 2023

  11. zewditu commented on Jan 3, 2023

    @zewditu
    zewditu
    on Jan 3, 2023
    Contributor

    It is not reproduceable from the latest main
    image

    image

  12. zewditu commented on Jan 3, 2023

    @zewditu
    zewditu
    on Jan 3, 2023
    Contributor

    Code behind generation missed installation of System.Data.SqlClient
    image

  13. zewditu commented on Jan 4, 2023

    @zewditu
    zewditu
    on Jan 4, 2023
    Contributor

    @v-Hailishi FYI: to validate code in the generated project you should use the newly mbconfig file, if you use old mbconfig file you might get some errors

  14. JakeRadMSFT commented on Jan 5, 2023

    @JakeRadMSFT
    JakeRadMSFT
    on Jan 5, 2023
    Member

    We're going to change our code to convert to strings for now in AutoML pipelines and CodeGen. We'll also look into supporting other types in ML.NET.

    @michaelgsharp has something that we've briefly tested and it works.

  15. JakeRadMSFT commented on Jan 5, 2023

    @JakeRadMSFT
    JakeRadMSFT
    on Jan 5, 2023
    Member

    For AutoML we can try the following change:

    https://github.com/dotnet/machinelearning/blob/a758217121c85cf5af9a2ea3f759feae2020d7b5/src/Microsoft.ML.AutoML/SweepableEstimator/Estimators/MapValueToKey.cs#L11

    Change to something like this:
    .Append(mlContext.Transforms.Conversion.MapValueToKey(param.OutputColumnName, param.InputColumnName, addKeyValueAnnotationsAsText: true))

  16. v-Hailishi commented on Jan 11, 2023

    @v-Hailishi
    v-Hailishi
    on Jan 11, 2023
    Author

    Verified on the latest main build 16.14.2.2306001, the generated Console App and Web API projects are still running failed on scenarios: Data classification, Value predication, Recommendation, Forecasting, Text classification scenarios.
    The following are the details:

    • Data classification

    1.1 File1 (https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv)
    Console App:
    image
    Web API:
    image

    1.2 File2 (https://testpass.blob.core.windows.net/test-pass-data/issues.tsv.txt)
    Console App: Run successful
    image
    Web API:
    image

    1.3 Microsoft SQL Server: Binary (SQL Password)
    Console App:
    image
    Web API:
    image

    1.4 Microsoft SQL Server Database File (https://github.com/dotnet/machinelearning-samples/raw/main/samples/modelbuilder/MulticlassClassification_RestaurantViolations/RestaurantScores.zip)
    Console App: Run successful
    image
    Web API:
    image

    • Value predication:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Console App: Run successful
    image

    Web API:
    File:
    image
    SQL:
    image

    • Recommendation:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Console App: Run successful
    image

    Web API:
    File:
    image
    SQL:
    image

    • Forecasting:
      Both of the generated Console App and Web API projects are still running failed

    File:
    image
    SQL:
    image

    • Text classification:

    Console App:
    image

    Web API:
    File:
    image
    SQL:
    image

  17. v-Hailishi commented on Jan 12, 2023

    @v-Hailishi
    v-Hailishi
    on Jan 12, 2023
    Author

    Verified on the latest main build 16.14.2.2306101, the generated Console App and Web API projects are still running failed on scenarios: Data classification, Value predication, Recommendation, Forecasting, Image Classification-Local, Text classification scenarios.
    The following are the details:

    • Data classification

    1.1 File1 (https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv)
    Console App: Run successful
    image
    Web API:
    image

    1.2 File2 (https://testpass.blob.core.windows.net/test-pass-data/issues.tsv.txt)
    Console App:
    image
    Web API:
    image

    1.3 Microsoft SQL Server: Binary (SQL Password)
    Console App:
    image
    Web API:
    image

    1.4 Microsoft SQL Server Database File (https://github.com/dotnet/machinelearning-samples/raw/main/samples/modelbuilder/MulticlassClassification_RestaurantViolations/RestaurantScores.zip)
    Console App:
    image
    Web API:
    image

    • Value predication & Recommendation:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Web API:
    File:
    image
    SQL:
    image

    • Forecasting:
      Both of the generated Console App and Web API projects are still running failed.

    File:
    image
    SQL:
    image

    • Image Classification-Local:
      The generated Console App project is running fail; the generated Web API project is running successfully.

    Console App:
    image

    • Text classification:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Console App: Run successful
    image

    Web API:
    File:
    image
    SQL:
    image

  18. v-Hailishi commented on Jan 18, 2023

    @v-Hailishi
    v-Hailishi
    on Jan 18, 2023
    Author

    Verified on the latest main build 16.14.2.2306701, the generated Console App and Web API projects are still running failed on scenarios: Data classification, Value predication, Recommendation, Forecasting, Image Classification-Local, Object detection, Text classification scenarios.
    The following are the details:

    • Data classification

    1.1 File (https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv)
    Console App: Run successful
    Web API: Failed (After removing the unnecessary using directive, can run successful)
    image

    1.2 Microsoft SQL Server: Binary (SQL Password)
    Console App: Failed
    image
    Web API: Failed
    image
    After removing the unnecessary using directive, still run failed.
    image

    1.3 Microsoft SQL Server Database File (https://github.com/dotnet/machinelearning-samples/raw/main/samples/modelbuilder/MulticlassClassification_RestaurantViolations/RestaurantScores.zip)
    Console App: Run successful
    Web API: Failed
    image
    After removing the unnecessary using directive, still run failed.
    image

    • Value predication & Recommendation:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Web API:
    File: (After removing the unnecessary using directive, can run successful)
    image
    SQL:
    image
    After removing the unnecessary using directive, still run failed.
    image

    • Forecasting:
      Both of the generated Console App and Web API projects are still running failed.

    File:
    Console App:
    image
    Web API:
    image

    SQL:
    Console App:
    image
    Web API:
    image

    • Image Classification-Local & Object detection:
      The generated Console App project is running successfully; the generated Web API project is running failed.

    Web API: (After removing the unnecessary using directive, can run successful)
    image

    • Text classification:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Web API:
    File: Failed (After removing the unnecessary using directive, can run successful)
    image

    SQL:
    image
    After removing the unnecessary using directive, still run failed.
    image

  19. v-Hailishi commented on Jan 20, 2023

    @v-Hailishi
    v-Hailishi
    on Jan 20, 2023
    Author

    Verified on the latest main build 16.14.2.2306903, the generated Console App and Web API projects are still running failed on scenarios: Data classification, Value predication, Recommendation, Forecasting, Text classification scenarios.
    The following are the details:

    • Data classification

    1.1 File (https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv)
    Console App: Run successful
    Web API: Run successful

    1.2 Microsoft SQL Server: Binary (SQL Password)
    Console App: Failed
    image
    Web API: Failed
    image

    1.3 Microsoft SQL Server Database File (https://github.com/dotnet/machinelearning-samples/raw/main/samples/modelbuilder/MulticlassClassification_RestaurantViolations/RestaurantScores.zip)
    Console App: Run successful
    Web API: Failed (After choosing "Use local version '4.8.3'" can run successful.)
    image

    • Value predication & Recommendation & Text classification:
      The generated Console App project is running successfully; the generated Web API project is running fail.

    Web API:
    File: Run successful
    SQL: Failed (After choosing "Use local version '4.8.3'" can run successful.)
    image

    • Forecasting:
      Both of the generated Console App and Web API projects are still running failed.

    File:
    Console App: Failed (After choosing "using System.IO;" can run successful.)
    image
    Web API: Failed
    image

    SQL:
    Console App: Failed (After choosing "using Microsoft.ML.Data;" and "using System.IO;" and "Use local version '4.8.3'" can run successful.)
    image
    Web API: Failed
    image

  20. v-Hailishi commented on Jan 31, 2023

    @v-Hailishi
    v-Hailishi
    on Jan 31, 2023
    Author

    Verified on the latest main build 16.14.3.2307701, the generated Console App and Web API projects are still running failed on scenarios: Data classification.

    • Data classification
      Only failed for Microsoft SQL Server: Binary (SQL Password)
      Console App: Failed

    image

    Web API: Failed

    image

  21. zewditu commented on Jan 31, 2023

    @zewditu
    zewditu
    on Jan 31, 2023
    Contributor

    @v-Hailishi what do you mean SQL password? is that a dataset, are you able to share your dataset? thanks

  22. v-Hailishi commented on Feb 1, 2023

    @v-Hailishi
    v-Hailishi
    on Feb 1, 2023
    Author

    @zewditu "SQL password" just means I use the SQL Server Authentication to log on to the server.
    image

    Besides, in the database, I use the dataset "https://testpass.blob.core.windows.net/test-pass-data/wikipedia-detox-250-line-data.tsv".
    image

  23. beccamc
    modified the milestones: January 2023, March 2023 on Feb 1, 2023

  24. beccamc commented on Feb 2, 2023

    @beccamc
    beccamc
    on Feb 2, 2023
    Contributor

    @zewditu This isn't regarding SQL. You can repro this by using a boolean type. I used the yelp dataset and set the prediction column to type boolean

    image

  25. v-Hailishi commented on Feb 7, 2023

    @v-Hailishi
    v-Hailishi
    on Feb 7, 2023
    Author

    The bug has been fixed on the latest main build 17.14.3.2310605.
    image

  26. v-Hailishi
    closed this as completedon Feb 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Priority:0Work that we can't release withoutReported by: Test

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions