-
Notifications
You must be signed in to change notification settings - Fork 578
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proposed updates to the RFC template #343
Draft
ematejska
wants to merge
6
commits into
master
Choose a base branch
from
ematejska-patch-5
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Changes from 1 commit
Commits
Show all changes
6 commits
Select commit
Hold shift + click to select a range
75174c2
Initial proposed updates to the RFC template
d0fcfcd
Updating the template to clarify API Design notes
a66328d
Updating to save a spot for the design review notes
0e0a110
Small grammar fixes
7be1166
Updating the API design section.
e446dfb
Fixing some grammar
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -2,10 +2,8 @@ | |
|
||
| Status | (Proposed / Accepted / Implemented / Obsolete) | | ||
:-------------- |:---------------------------------------------------- | | ||
| **RFC #** | [NNN](https://github.com/tensorflow/community/pull/NNN) (update when you have community PR #)| | ||
| **Author(s)** | My Name ([email protected]), AN Other ([email protected]) | | ||
| **Sponsor** | A N Expert ([email protected]) | | ||
| **Updated** | YYYY-MM-DD | | ||
| **Obsoletes** | TF-RFC it replaces, else remove this header | | ||
|
||
## Objective | ||
|
@@ -18,56 +16,39 @@ non-goals? This is your executive summary; keep it short, elaborate below. | |
Why this is a valuable problem to solve? What background information is needed | ||
to show how this design addresses the problem? | ||
|
||
Which users are affected by the problem? Why is it a problem? What data supports | ||
this? What related work exists? | ||
|
||
## User Benefit | ||
|
||
How will users (or other contributors) benefit from this work? What would be the | ||
headline in the release notes or blog post? | ||
|
||
## Design Proposal | ||
|
||
This is the meat of the document, where you explain your proposal. If you have | ||
multiple alternatives, be sure to use sub-sections for better separation of the | ||
idea, and list pros/cons to each approach. If there are alternatives that you | ||
have eliminated, you should also list those here, and explain why you believe | ||
your chosen approach is superior. | ||
headline in the release notes or blog post? What data supports | ||
this? What related work exists? | ||
|
||
Make sure you’ve thought through and addressed the following sections. If a section is not relevant to your specific proposal, please explain why, e.g. your RFC addresses a convention or process, not an API. | ||
## Proposed Solution | ||
Describe your solution to the problem. Provide examples and describe how they work. Show how your solution is better than current workarounds (if there are any). | ||
|
||
## Detailed Design | ||
|
||
### Alternatives Considered | ||
* Make sure to discuss the relative merits of alternatives to your proposal. | ||
Describe the design of the solution in detail. If it's a new API, show the full API and its documentation comments detailing what it does. The detail in this section should be sufficient for someone who is not one of the authors to be able to reasonably implement the feature. | ||
|
||
### Performance Implications | ||
* Do you expect any (speed / memory)? How will you confirm? | ||
* There should be microbenchmarks. Are there? | ||
* There should be end-to-end tests and benchmarks. If there are not (since this is still a design), how will you track that these will be created? | ||
* If design changes existing API or creates new ones, the design owner should create end-to-end examples (ideally, a tutorial) which reflects how new feature will be used. Some things to consider related to the tutorial: | ||
- The minimum requirements for this are to consider how this would be used in a Keras-based workflow, as well as a non-Keras (low-level) workflow. If either isn’t applicable, explain why. | ||
- It should show the usage of the new feature in an end to end example (from data reading to serving, if applicable). Many new features have unexpected effects in parts far away from the place of change that can be found by running through an end-to-end example. TFX [Examples](https://github.com/tensorflow/tfx/tree/master/tfx/examples) have historically been good in identifying such unexpected side-effects and are as such one recommended path for testing things end-to-end. | ||
- This should be written as if it is documentation of the new feature, i.e., consumable by a user, not a TensorFlow developer. | ||
- The code does not need to work (since the feature is not implemented yet) but the expectation is that the code does work before the feature can be merged. | ||
|
||
### Dependencies | ||
* Dependencies: does this proposal add any new dependencies to TensorFlow? | ||
* Dependent projects: are there other areas of TensorFlow or things that use TensorFlow (TFX/pipelines, TensorBoard, etc.) that this affects? How have you identified these dependencies and are you sure they are complete? If there are dependencies, how are you managing those changes? | ||
## User Impact | ||
What are the user-facing changes? How will this feature be rolled out? | ||
|
||
### Engineering Impact | ||
## Engineering Impact | ||
Please answer the following: | ||
* Do you expect changes to binary size / startup time / build time / test times? | ||
* Who will maintain this code? Is this code in its own buildable unit? Can this code be tested in its own? Is visibility suitably restricted to only a small API surface for others to use? | ||
|
||
### Platforms and Environments | ||
* Platforms: does this work on all platforms supported by TensorFlow? If not, why is that ok? Will it work on embedded/mobile? Does it impact automatic code generation or mobile stripping tooling? Will it work with transformation tools? | ||
* Execution environments (Cloud services, accelerator hardware): what impact do you expect and how will you confirm? | ||
|
||
### Best Practices | ||
* Does this proposal change best practices for some aspect of using/developing TensorFlow? How will these changes be communicated/enforced? | ||
|
||
### Tutorials and Examples | ||
* If design changes existing API or creates new ones, the design owner should create end-to-end examples (ideally, a tutorial) which reflects how new feature will be used. Some things to consider related to the tutorial: | ||
- The minimum requirements for this are to consider how this would be used in a Keras-based workflow, as well as a non-Keras (low-level) workflow. If either isn’t applicable, explain why. | ||
- It should show the usage of the new feature in an end to end example (from data reading to serving, if applicable). Many new features have unexpected effects in parts far away from the place of change that can be found by running through an end-to-end example. TFX [Examples](https://github.com/tensorflow/tfx/tree/master/tfx/examples) have historically been good in identifying such unexpected side-effects and are as such one recommended path for testing things end-to-end. | ||
- This should be written as if it is documentation of the new feature, i.e., consumable by a user, not a TensorFlow developer. | ||
- The code does not need to work (since the feature is not implemented yet) but the expectation is that the code does work before the feature can be merged. | ||
## Performance Implications | ||
Please answer the following: | ||
* Do you expect any changes to performance (speed / memory)? How will you confirm? | ||
* There should be microbenchmarks. Are there? | ||
* There should be end-to-end tests and benchmarks. If there are not (since this is still a design), how will you track that these will be created? | ||
|
||
### Compatibility | ||
## Compatibility | ||
Please answer the following: | ||
* Does the design conform to the backwards & forwards compatibility [requirements](https://www.tensorflow.org/programmers_guide/version_compat)? | ||
* How will this proposal interact with other parts of the TensorFlow Ecosystem? | ||
- How will it work with TFLite? | ||
|
@@ -76,15 +57,23 @@ Make sure you’ve thought through and addressed the following sections. If a se | |
- Will this work on GPU/TPU? | ||
- How will it serialize to a SavedModel? | ||
|
||
### User Impact | ||
* What are the user-facing changes? How will this feature be rolled out? | ||
## Dependencies | ||
Does this proposal add any new dependencies to TensorFlow? Are there other areas of TensorFlow or things that use TensorFlow (TFX/pipelines, TensorBoard, etc.) that this affects? How have you identified these dependencies and are you sure they are complete? If there are dependencies, how are you managing those changes? | ||
|
||
## Detailed Design | ||
## Platforms and Environments | ||
Please answer the following: | ||
* Platforms: does this work on all platforms supported by TensorFlow? If not, why is that ok? Will it work on embedded/mobile? Does it impact automatic code generation or mobile stripping tooling? Will it work with transformation tools? | ||
* Execution environments (Cloud services, accelerator hardware): what impact do you expect and how will you confirm? | ||
|
||
This section is optional. Elaborate on details if they’re important to | ||
understanding the design, but would make it hard to read the proposal section | ||
above. | ||
## Best Practices | ||
Does this proposal change best practices for some aspect of using/developing TensorFlow? How will these changes be communicated/enforced? | ||
|
||
## Questions and Discussion Topics | ||
## Tutorials, Examples and Documentation | ||
What is the plan for documentation? | ||
|
||
## Alternatives | ||
If there are alternatives that you have eliminated, you should also list those here, and explain why you believe | ||
your chosen approach is superior. List pros/cons to each approach. | ||
|
||
## Questions and Discussion Topics | ||
Seed this with open questions you require feedback on from the RFC process. |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The number header was added relatively recently to help people feel comfortable with referring to RFCs by number if they wished. It would be good to heart from the developer community if they still care about being able to do this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, I'll check.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In practice, nobody has been using this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I do feel like it could be pretty straightforward to refer to an RFC number as you would an issue or PR number without it being explicitly numbered here. I find myself updating this field for all submitted RFCs, so in the name of reducing busywork I'm pro dropping it.
@bhack any thoughts here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think that it is quite useful to have a reference to the PR to retrieve the context, the review comments and original related discussions to the RFC. These are available only in the PR after the RFC is merged.
But if it cannot be managed/updated and generally the RFC is not updated with subsequent PRs it could be quite easy to find the original PR on github.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
git/github history would also show at what PR it was merged, although it would require a few more clicks