Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update README.md #5

Open
wants to merge 3 commits into
base: development
Choose a base branch
from
Open

Update README.md #5

wants to merge 3 commits into from

Conversation

NehaDalmia
Copy link
Collaborator

No description provided.

@NehaDalmia
Copy link
Collaborator Author

Updated the readme to include log formats and new apk

Copy link
Contributor

@JackMostow JackMostow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Filename should include tablet ID (serial number).
  • Filenames should include Unix epoch as well as human-readable timestamp.
  • Good that you included an example! But it needs >1 face to disambiguate:
  • It's not clear that "Bounding boxes" is list of strings and "HOGS" is a list of lists of floats.
  • Please include an example to illustrate how they look when there are multiple faces.
  • Specify explicitly if lists of bounding boxes, of landmarks, and of HOGS are in the same order.
  • Specify whether faces are ordered by decreasing area.
  • Specify that HOGs are omitted when resolution is too low to compute them.

@NehaDalmia
Copy link
Collaborator Author

NehaDalmia commented Jul 27, 2021 via email

@JackMostow
Copy link
Contributor

JackMostow commented Jul 27, 2021 via email

@NehaDalmia
Copy link
Collaborator Author

NehaDalmia commented Jul 28, 2021 via email

@JackMostow
Copy link
Contributor

@NehaDalmia - Please clarify what "it" means in "it be changed in the future":

  1. RoboFeel's ability to output HOGs for multiple faces? If so, good.
  2. The ability of RoboFeel's output format to represent HOGs for multliple faces? If so, not good, because it means that future analysis code will require a different input format. I want the same analysis code to handle RoboFeel output whether for 1 face or >1.
    Thanks. - Jack

@NehaDalmia
Copy link
Collaborator Author

NehaDalmia commented Jul 28, 2021 via email

@JackMostow
Copy link
Contributor

I mean whatever code is going to operate on your output files, e.g. to compute FAUs, infer affective states, correlate gaze with user actions (or inaction), etc. Initially I expect to do these operations off-line, but we'll eventually need to do them on-board if we want to use visual cues to guide RoboTutor behavior in realtime, not just inform its (re-)design.

@NehaDalmia
Copy link
Collaborator Author

NehaDalmia commented Jul 28, 2021 via email

@JackMostow
Copy link
Contributor

Good. As I recall, when we discussed the file format, I had proposed grouping together all the information about each face (bounding box, landmarks, optional HOGs), but you explained that the standard representation groups information by type, and relies on listing faces in the same order for each type (which makes me nervous about inadvertently different orders). A consequence is that the list of HOGs will need to represent explicitly null HOGS for faces without them. Otherwise it may be ambiguous which faces have HOGs and which faces do not, unless we rely on risky assumptions about the order of faces in the representation. It's not an issue yet because for now only the first face will have HOG. But we should plan for multiple faces.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants