Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

empty tokens #56

Open
odanoburu opened this issue Mar 27, 2018 · 6 comments
Open

empty tokens #56

odanoburu opened this issue Mar 27, 2018 · 6 comments

Comments

@odanoburu
Copy link
Contributor

has support for empty tokens been added yet? I'm mirroring this issue from hs-conllu so we can fix this in both libraries. a CoNLL-U file that can be used for testing is this one.

(I'm asking and not testing myself because I'm getting this error when loading the library:

COMPILE-FILE-ERROR while
compiling #<CL-SOURCE-FILE "iterate" "iterate">
   [Condition of type UIOP/LISP-BUILD:COMPILE-FILE-ERROR]

)
@arademaker
Copy link
Contributor

It is clear that we need to support empty nodes. See docs http://universaldependencies.org/format.html#words-tokens-and-empty-nodes

But your error is strange, we are not using the iterate library! thanks for report the problem.

@odanoburu
Copy link
Contributor Author

But your error is strange, we are not using the iterate library!

not even as a transitive dependency? that's weird!

@odanoburu
Copy link
Contributor Author

I've updated the code and it now works!

@odanoburu
Copy link
Contributor Author

it doesn't parse here:

CL-USER> (defparameter *sents* (cl-conllu:read-conllu #P"/home/bruno/Documents/en-ud-train.conllu"))
; Evaluation aborted on #<SB-KERNEL:BOUNDING-INDICES-BAD-ERROR expected-type:
                                       (CONS (INTEGER 0 6) (INTEGER 7 6))
                                       datum: (7)>.

@GPPassos
Copy link
Contributor

GPPassos commented May 3, 2018

@odanoburu The sentence you linked gives a 404 error here.

@odanoburu
Copy link
Contributor Author

https://github.com/UniversalDependencies/UD_English-EWT/blob/master/en_ewt-ud-train.conllu

eu daria a linha, mas pode mudar..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@arademaker @GPPassos @odanoburu