Skip to content
This repository was archived by the owner on Oct 6, 2025. It is now read-only.
This repository was archived by the owner on Oct 6, 2025. It is now read-only.

How to evaluate a Seq2Seq model ? #78

Description

@mellahysf

Hi,

I have built a se2seq model that takes the question and generates the SQL query directly.

My question is how to evaluate my model since the predictions are in sequence format ("select .... from ... where...")?

It's very urgent, please.

Thanks

Activity

  1. jaytimbadia commented on Mar 23, 2021

    @jaytimbadia

    Hi @mellahysf
    How can one train on a custom SQLite file or database?
    Can you please provide the steps or can share your training script if possible?

    Thank you!

  2. Timothyxxx commented on Aug 3, 2021

    @Timothyxxx

    Hi~A simple solution is to use the evaluation from Spider dataset https://github.com/taoyds/spider which has great written parser to formulate the sql. Otherwise, since the formulation of WikiSQL is quiet simple, you can just write a parser for you generated SQL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions