hadoop - Design questions for long running yarn applications -


i trying write yarn application , hoping suggestions on few design questions had in mind. have gone through simpler sample apps distributed shell , variations of familiar basic api. create application has web interface user can interact , potentially provide kind of tasks (nature of tasks irrelevant). based on work, ui requests containers processing.

the ideal arrangement comes mind application master provides web ui , no containers allocated until comes website , requests work. @ point, should able register new containers , allocate work them.

  1. if provides web ui , understanding chosen rm every time application submitted rm. means can have different ip and, therefore, different url upon application restart. behavior suggests should not used such purpose , potentially different application (non-yarn) can provide web ui , better suited it?
  2. in examples, have seen sample yarn apps requests containers part of invocation. can please point related apis allow requesting containers @ later time or potentially lets modifying resource requirements (memory) of claimed containers or increasing number of containers on demand
  3. similar last point, examples focus on yarn application , end. can imagine application make sense continue run forever (as web app). these long running application client rm api changes. ok disconnect client submission job process or start using & run in background

i appreciate suggestions

in regards question (1) can run in unmanaged mode. allow run outside of yarn cluster on dedicated machine ip address have more control over.


-

Popular posts from this blog

html/hta mutiple file in audio player -

ok started coding .hta application , pretty html page .hta extension , adde mp3 player , did work <object data="test.mp3" type="audio/mp3" width="200" height="40"> <param name="src" value="test.mp3"> <param name="autostart" value="0"> </object> but it's 1 song playing again , again , plz there way add multiple files playlist believe it's should added "src" parameters not sure, i'm starting did add "," in between , , tried ";" none of them working i'm waiting answers :d i wanna know if can show me how become familiar tag see it's helpful , powerful activex, audio,video,pdf .... files i'm waiting impatiently [i don't know object, plz plz more clear] get inspired example hta_audio_player.hta <html> <head> <title>hackoo audio player playlist hackoo 2014</title> <hta:app...
Read more

debugging - Reference - What does this error mean in PHP? -

what this? this number of answers warnings, errors , notices might encounter while programming php , have no clue how fix. community wiki, invited participate in adding , maintaining list. why this? questions "headers sent" or "calling member of non-object" pop on stack overflow. root cause of questions same. answers questions typically repeat them , show op line change in his/her particular case. these answers not add value site because apply op's particular code. other users having same error can not read solution out of because localized. sad, because once understood root cause, fixing error trivial. hence, list tries explain solution in general way apply. what should here? if question has been marked duplicate of this, please find error message below , apply fix code. answers contain further links investigate in case shouldn't clear general answer alone. if want contribute, please add "favorite" error message, warning or notic...
Read more