How to trigger and run Jupyter notebook from SSIS
I have a data processing pipeline in SSIS and the prepared data set will be consumed by a machine learning modelling program in Jupyter notebook (Python, sklearn). I would like to know how to launch/trigger running the entire Jupyter notebook in SSIS whenever I have the data preparation complete? How about if I have a Python function defined in a cell, how can I invoke that specific cell/function only?
python ssis jupyter-notebook
asked Nov 19 at 11:31
menorah84
2,34193167
add a comment |
I have a data processing pipeline in SSIS and the prepared data set will be consumed by a machine learning modelling program in Jupyter notebook (Python, sklearn). I would like to know how to launch/trigger running the entire Jupyter notebook in SSIS whenever I have the data preparation complete? How about if I have a Python function defined in a cell, how can I invoke that specific cell/function only?
python ssis jupyter-notebook
asked Nov 19 at 11:31
menorah84
2,34193167
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09
add a comment |
I have a data processing pipeline in SSIS and the prepared data set will be consumed by a machine learning modelling program in Jupyter notebook (Python, sklearn). I would like to know how to launch/trigger running the entire Jupyter notebook in SSIS whenever I have the data preparation complete? How about if I have a Python function defined in a cell, how can I invoke that specific cell/function only?
python ssis jupyter-notebook
asked Nov 19 at 11:31
menorah84
2,34193167
I have a data processing pipeline in SSIS and the prepared data set will be consumed by a machine learning modelling program in Jupyter notebook (Python, sklearn). I would like to know how to launch/trigger running the entire Jupyter notebook in SSIS whenever I have the data preparation complete? How about if I have a Python function defined in a cell, how can I invoke that specific cell/function only?
python ssis jupyter-notebook
python ssis jupyter-notebook
asked Nov 19 at 11:31
menorah84
2,34193167
asked Nov 19 at 11:31
menorah84
2,34193167
asked Nov 19 at 11:31
menorah84
2,34193167
asked Nov 19 at 11:31
menorah84
2,34193167
asked Nov 19 at 11:31
menorah84
2,34193167
2,34193167
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09
add a comment |
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373726%2fhow-to-trigger-and-run-jupyter-notebook-from-ssis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373726%2fhow-to-trigger-and-run-jupyter-notebook-from-ssis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
How you would do these things if you were doing them manually? Since I don't know how to do them manually, I can't tell you how to automate them, but if you give us some insight on how you do it, we might be able to help. Perhaps a Execute Process Task?
– Jeremy J.
Nov 19 at 18:09