Arcpy multiprocessing arcpy.Select_analysis The Next CEO of Stack OverflowWhy Can't ArcPy...
Is a distribution that is normal, but highly skewed, considered Gaussian?
What is the difference between "hamstring tendon" and "common hamstring tendon"?
TikZ: How to fill area with a special pattern?
Is there a difference between "Fahrstuhl" and "Aufzug"?
Players Circumventing the limitations of Wish
Easy to read palindrome checker
Film where the government was corrupt with aliens, people sent to kill aliens are given rigged visors not showing the right aliens
In the "Harry Potter and the Order of the Phoenix" video game, what potion is used to sabotage Umbridge's speakers?
What CSS properties can the br tag have?
Why is information "lost" when it got into a black hole?
Airplane gently rocking its wings during whole flight
how one can write a nice vector parser, something that does pgfvecparse{A=B-C; D=E x F;}
Why is the US ranked as #45 in Press Freedom ratings, despite its extremely permissive free speech laws?
Scary film where a woman has vaginal teeth
Graph of the history of databases
Is it correct to say moon starry nights?
Reshaping json / reparing json inside shell script (remove trailing comma)
How did Beeri the Hittite come up with naming his daughter Yehudit?
vector calculus integration identity problem
Is there a way to save my career from absolute disaster?
Physiological effects of huge anime eyes
My ex-girlfriend uses my Apple ID to login to her iPad, do I have to give her my Apple ID password to reset it?
How to avoid supervisors with prejudiced views?
Is it ok to trim down a tube patch?
Arcpy multiprocessing arcpy.Select_analysis
The Next CEO of Stack OverflowWhy Can't ArcPy Search the Newly Created FeatureArcGIS Copy Features tool extremely slow when exporting to ArcSDE?Multiprocessing issues with ArcPySetting ArcPy environment variables with Python multiprocessing?Arcpy and multiprocessing not workingBatch intersect and multiprocessing with arcpyCombining python (parallel) multiprocessing toolbox with arcpyAccessing differing geodatabase schemas from arcpyarcpy and multiprocessing: switch workflow to shapefiles to avoid schemalocksMultiprocessing GALayerToRasters
I have the following script:
import arcpy
from arcpy import env
import datetime
import os
env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
dataFC = arcpy.ListFeatureClasses("","","Contours")
outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
query = "objectid > 0 AND objectid <= 200000 "
for fc in dataFC:
if fc == 'Contours':
output = outpath + os.sep + fc
arcpy.Select_analysis(fc, output+'200k', query)
Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.
What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.
How would I go about doing that?
I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.
Thanks!
arcpy select parallel-processing
New contributor
add a comment |
I have the following script:
import arcpy
from arcpy import env
import datetime
import os
env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
dataFC = arcpy.ListFeatureClasses("","","Contours")
outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
query = "objectid > 0 AND objectid <= 200000 "
for fc in dataFC:
if fc == 'Contours':
output = outpath + os.sep + fc
arcpy.Select_analysis(fc, output+'200k', query)
Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.
What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.
How would I go about doing that?
I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.
Thanks!
arcpy select parallel-processing
New contributor
add a comment |
I have the following script:
import arcpy
from arcpy import env
import datetime
import os
env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
dataFC = arcpy.ListFeatureClasses("","","Contours")
outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
query = "objectid > 0 AND objectid <= 200000 "
for fc in dataFC:
if fc == 'Contours':
output = outpath + os.sep + fc
arcpy.Select_analysis(fc, output+'200k', query)
Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.
What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.
How would I go about doing that?
I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.
Thanks!
arcpy select parallel-processing
New contributor
I have the following script:
import arcpy
from arcpy import env
import datetime
import os
env.workspace = r"Q:\SDEDirect Connection to Contours.sde"
dataFC = arcpy.ListFeatureClasses("","","Contours")
outpath = r'C:UsersTESTDesktopSDE Conversion ProjectTEST.gdb'
query = "objectid > 0 AND objectid <= 200000 "
for fc in dataFC:
if fc == 'Contours':
output = outpath + os.sep + fc
arcpy.Select_analysis(fc, output+'200k', query)
Currently it selects records that have objectid between 0 and 200,000 and creates a feature class called Contours 200k in the TEST gdb.
What I want to be able to do is make a multiprocessing script that utilises one core to calculated between object id 0 and 200k, another that calculates betweek 200,001 and 400k and so on until the whole feature class is copied over as separate feature sets to the TEST gdb.
How would I go about doing that?
I'm trying to do this since the bottleneck of copying from the sde is the network connection and testing with separate files where I had the ranges set manually improved the overall speed a lot.
Thanks!
arcpy select parallel-processing
arcpy select parallel-processing
New contributor
New contributor
New contributor
asked 4 mins ago
user139485user139485
61
61
New contributor
New contributor
add a comment |
add a comment |
0
active
oldest
votes
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "79"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
user139485 is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f317298%2farcpy-multiprocessing-arcpy-select-analysis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
user139485 is a new contributor. Be nice, and check out our Code of Conduct.
user139485 is a new contributor. Be nice, and check out our Code of Conduct.
user139485 is a new contributor. Be nice, and check out our Code of Conduct.
user139485 is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Geographic Information Systems Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f317298%2farcpy-multiprocessing-arcpy-select-analysis%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown