Skip to content

require() resolution cache #25

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tmm1 wants to merge 7 commits into from
Closed

require() resolution cache #25

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
2d02be5
add REQUIRE_CACHE_{READ_WRITE} env vars
tmm1 Feb 11, 2015
25e98f7
cache lookup failures too
tmm1 Feb 11, 2015
bbbca3c
clear out REQUIRE_CACHE_WRITE for any subprocesses
tmm1 Feb 12, 2015
c9721f4
change debug msg
tmm1 Feb 12, 2015
1089cf1
use st_lookup instead of st_delete, and emulate search_required behavior
tmm1 Feb 12, 2015
8afbab4
short circuit require("enumerator")
tmm1 Mar 6, 2015
faa994c
ignore READ variable in WRITE mode
tmm1 Mar 6, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
cache lookup failures too
  • Loading branch information
@tmm1
tmm1 committed Feb 11, 2015
commit 25e98f767546b8aef78f751f6973c684f9899eaf
22 changes: 16 additions & 6 deletions load.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -961,7 +961,7 @@ rb_require_safe(VALUE fname, int safe)
PUSH_TAG();
saved.safe = rb_safe_level();
if ((state = EXEC_TAG()) == 0) {
VALUE ipath, path;
VALUE ipath, path = 0;
long handle;
int found;
st_data_t key, val;
Expand All @@ -982,19 +982,29 @@ rb_require_safe(VALUE fname, int safe)
key = (st_data_t)RSTRING_PTR(ipath);
if (st_delete(vm->require_cache.tbl, &key, &val)) {
vals = (char *)val;
if ((found = vals[0])) {
//fprintf(stderr, "FOUND '%s' => '%s'\n", (char *)key, vals);
found = vals[0];
if (found) {
/*fprintf(stderr, "FOUND '%s' => '%s'\n", (char *)key, vals);*/
path = rb_str_new_cstr(vals+1);
}
xfree(vals);
} else {
found = search_required(ipath, &path, safe);
/*if (found && path)
fprintf(stderr, "MISSING '%s' => '%s'\n", RSTRING_PTR(ipath), RSTRING_PTR(path));*/
}
} else {
found = search_required(ipath, &path, safe);
/*if (found && RSTRING_PTR(ipath)[0] != '/')
fprintf(stderr, "SEARCHING '%s'\n", RSTRING_PTR(ipath));*/
}
if (vm->require_cache.write && RSTRING_PTR(ipath)[0] != '/' && path) {
fprintf(vm->require_cache.out, "%s\n%c%s\n", RSTRING_PTR(ipath), found ? found : '\0', found ? RSTRING_PTR(path) : "");
if (vm->require_cache.write && RSTRING_PTR(ipath)[0] != '/' && (!found || (found && path))) {
/*fprintf(stderr, "WRITING '%s' => '%s'\n", RSTRING_PTR(ipath), found ? RSTRING_PTR(path) : "");*/
fprintf(vm->require_cache.out, "%s\n", RSTRING_PTR(ipath));
Copy link
Author

@tmm1 tmm1 Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These fprintfs happen back to back, so I can't figure out why one writes sane data (to stderr) and the other ends up corrupting the cache file.

Copy link

@vmg vmg Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tmm1: RSTRING_PTR is not assured to be NULL-terminated. Try StringValueCStr() instead?

Copy link
Author

@tmm1 tmm1 Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I thought that might be why, so I tried fprintf("%.*s", RSTRING_LEN(ipath), RSTRING_PTR(ipath)) but that didn't help either.

Copy link
Author

@tmm1 tmm1 Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just tried StringValueCStr and no difference. It's super weird that the corruption always happens after loading thread.bundle, so I wonder if that's affecting the open file handle somehow.

Copy link
Author

@tmm1 tmm1 Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might be related to this, which calls back into load.c:

ext/thread/thread.c:    rb_provide("thread.rb");

Copy link

@vmg vmg Feb 11, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hah. Sounds like a fun one. I'm definitely digging this tomorrow if you haven't figured it out by then. :))

if (found)
fprintf(vm->require_cache.out, "%c%s\n", found, RSTRING_PTR(path));
else
fprintf(vm->require_cache.out, "%s\n", "");
fsync(fileno(vm->require_cache.out));
}

Expand Down Expand Up @@ -1193,7 +1203,7 @@ require_cache_setup()
if (!fgets(line2, PATH_MAX+2, file)) break;
line1[strlen(line1)-1] = 0;
line2[strlen(line2)-1] = 0;
//fprintf(stderr, "INSERTING '%s' => '%s'\n", line1, line2);
/*fprintf(stderr, "INSERTING '%s' => '%s'\n", line1, line2);*/
st_insert(vm->require_cache.tbl, (st_data_t)ruby_strdup(line1), (st_data_t)ruby_strdup(line2));
}
fclose(file);
Expand Down